-- Logs begin at Thu 2022-07-28 16:47:49 UTC, end at Thu 2022-07-28 18:38:34 UTC. -- Jul 28 18:03:19.374837 dv-cinder-846173-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 28 18:03:19.384041 dv-cinder-846173-4-iscsi devstack@n-api.service[103923]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 28 18:03:19.386714 dv-cinder-846173-4-iscsi devstack@n-api.service[103923]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 28 18:03:19 2022] *** Jul 28 18:03:19.386714 dv-cinder-846173-4-iscsi devstack@n-api.service[103923]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 28 18:03:19.386714 dv-cinder-846173-4-iscsi devstack@n-api.service[103923]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 28 18:03:19.386714 dv-cinder-846173-4-iscsi devstack@n-api.service[103923]: nodename: dv-cinder-846173-4-iscsi Jul 28 18:03:19.386714 dv-cinder-846173-4-iscsi devstack@n-api.service[103923]: machine: x86_64 Jul 28 18:03:19.386714 dv-cinder-846173-4-iscsi devstack@n-api.service[103923]: clock source: unix Jul 28 18:03:19.386714 dv-cinder-846173-4-iscsi devstack@n-api.service[103923]: pcre jit disabled Jul 28 18:03:19.386714 dv-cinder-846173-4-iscsi devstack@n-api.service[103923]: detected number of CPU cores: 4 Jul 28 18:03:19.386714 dv-cinder-846173-4-iscsi devstack@n-api.service[103923]: current working directory: / Jul 28 18:03:19.386714 dv-cinder-846173-4-iscsi devstack@n-api.service[103923]: detected binary path: /usr/bin/uwsgi-core Jul 28 18:03:19.387379 dv-cinder-846173-4-iscsi devstack@n-api.service[103923]: your processes number limit is 47680 Jul 28 18:03:19.387379 dv-cinder-846173-4-iscsi devstack@n-api.service[103923]: your memory page size is 4096 bytes Jul 28 18:03:19.387379 dv-cinder-846173-4-iscsi devstack@n-api.service[103923]: detected max file descriptor number: 2048 Jul 28 18:03:19.387379 dv-cinder-846173-4-iscsi devstack@n-api.service[103923]: lock engine: pthread robust mutexes Jul 28 18:03:19.387379 dv-cinder-846173-4-iscsi devstack@n-api.service[103923]: thunder lock: enabled Jul 28 18:03:19.387379 dv-cinder-846173-4-iscsi devstack@n-api.service[103923]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 28 18:03:19.387379 dv-cinder-846173-4-iscsi devstack@n-api.service[103923]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 28 18:03:19.426334 dv-cinder-846173-4-iscsi devstack@n-api.service[103923]: Python main interpreter initialized at 0x564bb50179c0 Jul 28 18:03:19.426334 dv-cinder-846173-4-iscsi devstack@n-api.service[103923]: python threads support enabled Jul 28 18:03:19.426334 dv-cinder-846173-4-iscsi devstack@n-api.service[103923]: your server socket listen backlog is limited to 100 connections Jul 28 18:03:19.426334 dv-cinder-846173-4-iscsi devstack@n-api.service[103923]: your mercy for graceful operations on workers is 90 seconds Jul 28 18:03:19.426664 dv-cinder-846173-4-iscsi devstack@n-api.service[103923]: mapped 403077 bytes (393 KB) for 2 cores Jul 28 18:03:19.426764 dv-cinder-846173-4-iscsi devstack@n-api.service[103923]: *** Operational MODE: preforking *** Jul 28 18:03:19.427041 dv-cinder-846173-4-iscsi devstack@n-api.service[103923]: *** uWSGI is running in multiple interpreter mode *** Jul 28 18:03:19.427041 dv-cinder-846173-4-iscsi devstack@n-api.service[103923]: spawned uWSGI master process (pid: 103923) Jul 28 18:03:19.427238 dv-cinder-846173-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 28 18:03:19.427865 dv-cinder-846173-4-iscsi devstack@n-api.service[103923]: spawned uWSGI worker 1 (pid: 103924, cores: 1) Jul 28 18:03:19.428181 dv-cinder-846173-4-iscsi devstack@n-api.service[103923]: spawned uWSGI worker 2 (pid: 103925, cores: 1) Jul 28 18:03:19.428325 dv-cinder-846173-4-iscsi devstack@n-api.service[103923]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 28 18:03:20.092667 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 28 18:03:20.104218 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 28 18:03:21.194965 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 18:03:21.194965 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: from cryptography.utils import int_from_bytes Jul 28 18:03:21.195648 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 18:03:21.195648 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: from cryptography.utils import int_from_bytes Jul 28 18:03:21.210020 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 18:03:21.210020 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: from cryptography.utils import int_from_bytes Jul 28 18:03:21.212027 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 18:03:21.212027 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: from cryptography.utils import int_from_bytes Jul 28 18:03:23.691037 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 18:03:23.691565 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 18:03:23.691737 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 18:03:23.691918 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 18:03:23.692305 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 18:03:23.692388 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 18:03:23.692462 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 18:03:23.692684 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 18:03:23.692811 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.693056 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.693162 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 18:03:23.693313 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 18:03:23.693408 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.693689 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.693793 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.694023 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.694110 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.694335 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.694428 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.694658 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.694752 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.694978 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.695071 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.695306 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.695405 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.695581 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.695676 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.695891 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.695997 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.696218 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846173-4-iscsi {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.696329 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.696512 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.696598 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.696823 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.696911 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.697193 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.697289 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846173-4-iscsi {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.697511 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.697604 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.697817 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.697935 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.698143 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.698268 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.698451 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.698584 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.698885 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.698982 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.699205 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.699401 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.699521 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.699712 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.700178 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.700372 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.700499 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.700593 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.700887 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.701034 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.701226 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.701335 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.701564 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.701654 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.702073 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.702159 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.702455 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.702561 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.702781 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.702910 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.703092 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.703199 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846173-4-iscsi {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.703413 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.703511 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.703719 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.703829 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.704100 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.704190 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846173-4-iscsi {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.704424 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.704527 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.704736 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.704833 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.705070 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.705165 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.705463 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.705562 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.705790 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.705893 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.706101 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.706200 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.706416 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.706514 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.706733 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.706842 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.707050 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.707149 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.707369 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.707455 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.707670 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.707772 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.707981 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.708080 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.708292 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.708383 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.708589 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.708683 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.708895 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.709033 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.709224 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.709318 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.709474 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.709620 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.709785 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.709923 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.710108 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.710239 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.710431 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.710517 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.710754 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.710851 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.711010 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.711105 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.711262 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.711362 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.711583 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.711670 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.711902 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.711999 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.712150 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.712246 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.712487 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.712597 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.712824 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.712922 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.713155 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.713254 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.713460 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.713556 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.713758 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.713857 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.714062 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.714162 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.714361 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.714473 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.714663 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.714775 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.714966 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.715054 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.715267 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.715361 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.715575 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.715666 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.715881 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.715973 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.716196 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.716289 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.86 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.716497 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.716671 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.86 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.716805 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.716900 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.717168 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.717269 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.86 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.717480 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.86 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.717574 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.717785 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.717871 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.718104 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.718203 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.718416 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.718515 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.718721 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.718807 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.719024 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.719110 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.719339 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.719434 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.719652 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.719743 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.719956 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.720041 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.720258 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.720352 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.720506 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.720600 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.720810 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.720942 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.721143 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.721308 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.721463 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.721549 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.721771 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.721857 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.722078 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.722166 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.722385 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.722472 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.722690 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.722797 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.723000 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.723106 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.723298 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.723395 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.723594 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.723686 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.723895 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.723985 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.724201 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.724293 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.724498 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.724601 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.724800 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.724910 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.725130 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.725227 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.725438 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.725538 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.725760 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.725846 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.726066 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.726160 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.726368 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.726464 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.726671 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.726757 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.726978 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.727077 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.727280 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.727378 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.727581 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.727667 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.727884 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.727985 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.728187 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.728290 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.729064 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.729167 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.729377 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.729471 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.729692 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.729787 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.730013 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.730106 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.730323 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.730409 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.730633 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.730729 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.730949 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.731035 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.731249 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.731381 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.731550 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.731648 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.731865 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.731951 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.732163 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.732251 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.732468 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.732554 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.732775 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.732885 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.733105 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.733210 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.733410 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.733509 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.733707 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.733797 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.734009 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.734099 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.734313 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.734403 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.734614 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.734714 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.734910 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.734995 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.735213 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.735301 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.735535 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.735621 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.735844 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.735948 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.736187 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.736281 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.736501 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.736585 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.736803 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.736897 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.737387 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.737494 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.737713 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:03:23.737806 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.738045 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.738141 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.738374 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.738461 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.738711 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.738796 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.739022 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.739109 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.739342 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.739434 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.739667 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.739761 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.739986 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.740072 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.740294 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.740381 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.740605 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.740690 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.740920 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.741050 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.741269 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.741357 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.741590 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.741680 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.741900 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.741986 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.742216 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.742324 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.742533 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.742619 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.742860 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.742964 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.743171 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.743272 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.743488 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.743595 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.743810 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.743901 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.744701 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.744814 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.745046 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.745155 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.745397 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.745485 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.745711 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.745803 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.746020 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.746116 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.746357 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.746444 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.746679 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.746772 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.746996 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.747096 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.747314 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.747401 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.747630 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.747726 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.747943 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.748037 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.748254 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.748347 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.748565 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.748659 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.748885 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.749006 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.749225 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.749313 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.749541 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.749633 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.749855 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.749954 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.750171 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.750265 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.750475 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.750568 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.750785 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.750874 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.751094 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.751189 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.751399 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.751486 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.751721 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.751819 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.752028 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.752115 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.752339 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.752425 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.752648 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.752743 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.752978 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.753080 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.753292 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.753391 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.753598 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.753700 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.753904 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.753992 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.754202 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.754298 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.754506 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.754600 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.754806 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.754894 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.755113 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.755209 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.755413 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.755506 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.755727 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.755814 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.756049 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.756143 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.756365 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.756464 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.756681 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.756768 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.756998 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.757097 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.757311 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.757402 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.757623 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.757720 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.757931 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.758019 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.758233 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.758327 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.758541 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.758628 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.758847 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.758935 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.759147 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.759240 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.759466 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.759566 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.759802 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.759889 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.760103 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.760194 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.760416 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.760509 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.760714 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.760807 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.761057 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.761146 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.761377 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.761476 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.761693 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.761782 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.762020 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.762108 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.762333 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.762429 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.762642 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.762735 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.762963 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.763137 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.763293 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.763481 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.763600 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.763814 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.763929 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.764258 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.764428 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.764576 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.764883 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.765056 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.765223 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.765535 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.765646 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.765838 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.765922 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.766143 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.766229 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.766455 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.766540 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.766761 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.766848 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.767067 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.767227 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.767371 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.767468 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.767677 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.767753 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.767981 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.768152 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.768324 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.768604 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.768739 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.768912 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.769249 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.769351 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.769557 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.769877 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.769971 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.770191 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.770453 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.770538 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.770858 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.770947 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.771176 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.771252 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.771498 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.771580 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.771813 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.771927 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.772187 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.772354 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.772445 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.772738 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.772826 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.773076 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.773241 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.773390 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.773493 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.773715 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.773816 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.774026 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.774114 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.774347 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.774500 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.774659 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.774825 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.774984 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.775150 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.775325 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.775492 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.775647 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.775813 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.775953 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.776126 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.776272 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.776439 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.776613 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.776751 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.776947 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.777138 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.777305 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.777466 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.777628 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.777803 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.777941 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.778124 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.778256 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.778434 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.778568 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.778757 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.778881 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.779065 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.779199 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.779384 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.779512 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.779687 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.779832 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.780005 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.780143 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.780343 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.780462 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.780674 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.780767 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.781027 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.781133 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.781330 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.781417 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.781641 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.781727 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.781957 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.782050 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.782268 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.782356 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.782577 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.782669 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.782886 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.782985 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.783194 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.783281 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.783511 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.783598 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.783821 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.783933 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.784137 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.784231 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.784447 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.784534 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.784763 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.784851 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.785099 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.785186 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.785411 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.785545 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.785725 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.785814 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.786034 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.786119 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.786346 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.786431 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.786659 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.786754 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.786956 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.787046 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.787271 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.787357 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.787581 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.787668 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.787887 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.787972 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.788190 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.788283 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.788497 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.788589 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.788802 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.788926 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.789130 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.789229 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.789439 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.789534 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.789751 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.789838 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.790063 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.790162 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.790372 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.790466 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.790671 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.790758 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.791514 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.791615 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.791821 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.791908 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.792136 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.792234 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.792442 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.792538 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.792750 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.792837 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.793093 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.793182 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.793405 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.793493 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.793723 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.793825 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.794043 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.794142 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.794347 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.794444 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.794649 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.794737 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.794964 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.795051 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.795269 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.795356 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.795585 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.795671 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.795892 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.795984 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.796195 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.796284 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.796508 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.796595 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.796824 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.796943 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.797149 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.797236 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.797466 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.797552 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.797789 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.797887 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.798104 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.798192 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.798421 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.798520 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.798737 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.798903 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.799042 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.799128 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.799358 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.799443 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.799679 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.799779 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.800029 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.800257 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.800342 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.800594 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.800689 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.800913 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.801027 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.801250 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.801337 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.801571 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.801665 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.801879 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.801975 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.802190 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.802317 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.802498 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.802597 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.802800 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.802887 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.803136 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.803236 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.803446 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.803568 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.803755 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.804060 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.804184 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.804369 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.804470 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.804678 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.804788 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.805003 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.805103 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.805316 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.805413 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.805695 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.805799 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.805938 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.806042 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.806248 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.806343 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.807116 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.807218 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.807437 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.807534 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.807756 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.807851 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.808064 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.808164 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.808379 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.808467 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.808687 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.808773 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.809018 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.809118 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.809329 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.809416 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.809635 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.809727 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.809941 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.810035 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.810244 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.810330 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.810544 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.810636 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.810867 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.810963 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.811170 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.811256 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.811482 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.811568 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.811784 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.811872 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.812095 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.812188 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.812396 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.812491 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.812715 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.812810 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.813048 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.813140 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.813355 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.813441 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.813656 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.813744 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.813960 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.814048 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.814272 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.814378 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.814577 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.814673 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.814893 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.814980 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.815206 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.815307 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.815519 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.815606 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.815831 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.815917 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.816137 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.816236 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.816449 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.816536 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.816749 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.816842 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.817079 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.817182 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.817385 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.817472 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.817686 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.817778 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.817991 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.818079 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.818293 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.818379 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.818600 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.818685 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.818905 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.818992 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.819220 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.819313 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.819525 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.819611 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.819841 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.819929 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.820146 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.820232 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.820450 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.820536 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.820755 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.820849 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.821090 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.821182 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.821391 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.821476 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.821692 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.821784 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.822000 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.822086 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.822332 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.822427 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.822634 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.822723 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.822936 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.823021 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.823237 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.823402 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.823540 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.823627 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.823836 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.823923 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.824141 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.824237 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.824441 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.824539 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.824745 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.824839 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.825078 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.825182 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.825392 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.825478 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.825699 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.825785 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.826009 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.826097 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.826309 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.826394 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.826609 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.826695 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.826910 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.826996 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.827208 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.827294 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.827509 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.827594 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.827811 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.827905 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.828114 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.828201 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.828429 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.828522 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.828732 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.828820 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.829066 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.829167 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.829377 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.829472 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.829681 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.829767 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.829982 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.830068 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.830287 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.830383 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.830588 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.830684 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.830909 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.830996 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.831208 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.831304 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.831508 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.831594 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.831809 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.831894 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.832129 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.832224 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.832453 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.832538 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.832758 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.832843 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.833089 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.833180 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.833393 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.833479 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.833713 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.833807 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.834020 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.834109 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.834327 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.834420 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.834653 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.834747 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.834972 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.835060 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.835286 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.835372 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.835610 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.835703 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.835916 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.836045 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.836224 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.836319 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.836524 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.836623 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.836840 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.836925 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.837176 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.837263 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.837498 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.837606 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.837823 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.837910 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.838132 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.838216 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.838443 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.838538 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.838749 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.838841 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.839057 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.839144 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.839369 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.839463 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.839684 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.839770 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.839992 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.840079 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.840291 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.840389 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.840599 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.840693 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.840903 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.841009 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.841231 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.841326 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.841537 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.841632 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.841846 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.841940 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.842156 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.842243 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.842461 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.842549 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.842764 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.842850 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.843068 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.843156 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.843371 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.843498 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.843675 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.843815 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.843987 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.844130 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.844293 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.844437 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.844593 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.844751 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.844912 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.845090 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.845260 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.845411 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.845561 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.845729 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.845868 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.846037 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.846174 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.846452 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.846549 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.846748 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.846835 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.847067 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.847173 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.847382 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.847477 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.847689 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.847775 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.847994 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.848087 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.848308 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.848404 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.848633 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.848728 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.848943 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.849073 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.849273 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.849371 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.849572 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.849657 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.849892 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.850004 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.850200 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.850361 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.850524 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.850672 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.850939 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.851026 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.851253 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.851342 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.851553 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.851637 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.851860 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.851945 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.852179 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.852269 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.852480 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.852566 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.852801 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.852896 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.853144 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.853245 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.854005 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.854146 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.854308 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.854395 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.854626 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.854714 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.854940 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.855025 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.855267 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.855374 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.855593 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.855681 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.855907 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.855994 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.856227 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.856327 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.856537 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.856624 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.856864 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.856953 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.857215 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.857313 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.857533 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.857630 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.857834 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.857927 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.858145 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.858260 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.858451 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.858590 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.858769 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.858906 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.859088 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.859237 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.859399 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.859566 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.859734 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.859876 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.860038 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.860184 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.860358 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.860499 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.860676 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.860806 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.861003 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.861142 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.861327 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.861468 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.861736 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.861823 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.862057 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.862395 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.862620 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.862709 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.862930 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.863023 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.863239 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.863326 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.863539 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.863629 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.863840 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.863927 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.864152 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.864248 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.864452 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.864538 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.864756 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.864849 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.865105 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.865207 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.865411 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.865507 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.865723 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.865873 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.866049 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.866146 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.866363 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.866451 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.866670 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.866763 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.866979 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.867075 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.867290 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.867395 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.867604 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.867697 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.867924 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.868013 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.868236 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.868323 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.868554 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.868648 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.868873 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.868986 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.869768 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.869912 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.870091 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.870220 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.870400 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.870531 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.870704 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.870831 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.871008 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.871145 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.871331 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.871457 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.871636 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.871763 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.871944 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.872084 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.872259 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.872387 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.872567 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.872693 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.872875 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.873054 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.873211 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.873339 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.873522 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.873649 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.873830 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.873975 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.874137 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.874263 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.874444 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.874583 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.874762 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.874905 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.875066 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.875193 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.875366 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.875491 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.875674 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.875799 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.875976 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.876101 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.876277 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.876402 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.876581 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.876711 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.876916 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.877064 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.877266 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.877390 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.877598 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.877723 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.877901 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.878039 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.878222 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.878351 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.878520 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.878656 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.878836 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.878972 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.879143 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.879288 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.879444 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.879571 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.879747 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.879888 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.880047 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.880194 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.880380 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.880504 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.880680 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.880826 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.881030 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.881174 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.881336 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.881462 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.881651 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.881790 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.881972 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.882112 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.882292 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.882418 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.882613 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.882739 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.882954 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.883145 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.883293 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.883475 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.883599 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.883796 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.883935 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.884117 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.884242 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.884438 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.884583 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.885329 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.885479 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.885646 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.885771 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.885960 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.886085 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.886273 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.886413 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.886592 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.886732 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.886906 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.887103 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.887248 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.887430 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.887557 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.887742 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.887868 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.888052 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.888197 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.888370 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.888492 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.888664 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.888798 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.888993 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.889138 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.889286 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.889437 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.889633 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.889798 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.889940 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.890119 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.890265 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.890432 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.890556 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.890751 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.890888 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.891071 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.891196 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.891388 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.891514 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.891703 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.891829 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.892020 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.892146 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.892341 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.892479 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.892654 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.893070 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.893250 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.893418 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.893605 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.893808 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.893945 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.894069 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.894195 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.894321 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.894461 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.894602 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.894741 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.894866 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.894991 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.895115 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.895240 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.895377 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.895523 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.895646 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.895773 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.895897 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.896180 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.896321 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.896487 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.896611 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.896821 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.897022 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.897225 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.897352 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.897549 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.897675 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.897873 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.897997 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.898193 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.898320 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.898524 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.898650 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.898840 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.899000 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.899135 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.899257 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.899449 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.899659 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.899786 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.899972 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.900098 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.900349 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.900477 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.901272 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.901413 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.901591 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.901716 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.901918 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.902054 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.902233 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.902358 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.902566 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.902768 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.902893 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.903119 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.903246 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.903439 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.903578 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.903764 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.903896 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.904068 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.904204 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.904389 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.904524 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.904700 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.904845 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.905003 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.905150 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.905319 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.905556 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.905710 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.905843 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.905966 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.906160 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.906298 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.906509 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.906633 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.906830 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.906975 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.907143 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.907283 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.907456 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.907581 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.907765 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.907891 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.908074 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.908209 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.908380 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.908554 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.908711 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.908837 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.909038 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.909173 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.909345 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.909482 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.909650 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.909774 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.909951 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.910075 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.910254 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.910379 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.910559 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.910683 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.910866 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.911000 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.911172 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.911298 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.911487 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.911623 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.911794 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.911920 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.912109 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.912234 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.912408 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.912543 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.912710 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.912836 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.913033 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.913163 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.913343 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.913486 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.913667 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.913855 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.913979 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.914106 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.914242 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.914377 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.914545 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.914681 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.914872 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.914996 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.915147 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.915271 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.915434 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.915559 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.915736 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.915863 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.916083 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.916210 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.916385 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.916509 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.916691 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.916827 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.917084 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.917321 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.917449 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.917660 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.917795 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.917982 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.918118 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.918296 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.918422 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.918606 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.918735 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.918922 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.919050 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.919236 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.919363 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.919548 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.919684 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.919876 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.920001 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.920192 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.920317 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.920506 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.920779 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.920917 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.921157 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.921282 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.921470 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.921596 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.921786 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.921930 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.922102 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.922230 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.922402 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.922526 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.922705 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.922830 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.923005 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.923130 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.923317 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.923448 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.923647 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.923769 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.923907 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.924032 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.924225 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.924348 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.924543 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.924679 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.924894 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.925092 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.925215 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.925370 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.925537 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.925663 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.925848 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.925973 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.926154 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.926294 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.926461 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.926598 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.926767 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.926893 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.927078 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.927241 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.927365 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.927492 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.927671 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.927796 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.927981 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.928107 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.928309 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.928433 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.928619 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.928747 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.929018 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.929179 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.929342 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.929482 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.929652 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.929777 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.929959 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.930084 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.930289 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.930425 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.930597 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.930739 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.930902 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.931027 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.931217 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.931352 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.931568 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.931705 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.931886 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.932012 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.932193 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.932320 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.932547 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.932688 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.932881 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.933064 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.933227 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.933363 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.933534 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.933659 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.933842 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.933979 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.934154 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.934284 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.934463 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.934599 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.934759 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.934898 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.935078 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.935211 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.935377 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.935502 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.935682 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.935806 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.935992 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.936117 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.936301 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.936426 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.936610 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.936735 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.936916 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.937095 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.937273 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.937408 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.937537 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.937663 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.937835 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.937973 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.938142 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.938269 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.938449 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.938574 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.938756 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.938907 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.939068 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.939225 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.939413 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.939546 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.939672 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.939813 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.939959 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.940083 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.940255 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.940379 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.940556 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.940681 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.940857 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.941100 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.941235 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.941358 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.941495 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.941618 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.941745 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.941879 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.942030 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.942156 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.942331 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.942456 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.942644 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.942768 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.942948 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.943091 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.943248 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.943374 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.943550 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.943675 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.943930 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.944074 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.944247 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.944370 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.944519 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.944644 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.944848 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.945020 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.945210 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.945354 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.945512 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.945636 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.945824 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.945965 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.946129 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.946253 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.946439 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.946573 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.946745 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.946879 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.947057 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.947702 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.947906 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.948032 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.948219 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.948345 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.948545 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.948668 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.948868 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.949036 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.949183 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.949384 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.949561 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.949683 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.949812 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.949949 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.950129 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.950255 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.950440 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.950566 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.950750 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.950886 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.951058 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.951192 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.951367 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.951493 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.951671 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.951812 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.951987 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.952111 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.952299 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.952424 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.952612 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.952816 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.952939 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.953126 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.953259 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.953385 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.953566 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.953698 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.953892 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.954018 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.954209 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.954400 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.954535 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.954658 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.954827 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.954961 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.955158 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.955288 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.955474 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.955602 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.955782 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.955908 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.956090 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.956228 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.956406 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.956532 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.956722 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.956849 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.957056 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.957201 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.957326 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 18:03:23.957453 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.957671 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.957994 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.958313 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.958710 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.959086 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.959501 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.959853 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.960192 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.960502 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.960807 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:03:23.961079 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 18:03:24.110245 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: INFO dbcounter [None req-754e7e4e-a387-4e97-ad03-0d369d224d16 None None] Registered counter for database nova_api Jul 28 18:03:24.120855 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: INFO dbcounter [None req-14918635-acbb-4a0f-a9f2-1e68db25590b None None] Registered counter for database nova_api Jul 28 18:03:24.131971 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG oslo_db.sqlalchemy.engines [None req-754e7e4e-a387-4e97-ad03-0d369d224d16 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103924) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 18:03:24.139117 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG dbcounter [-] [103924] Writer thread running {{(pid=103924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 18:03:24.141276 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG oslo_db.sqlalchemy.engines [None req-14918635-acbb-4a0f-a9f2-1e68db25590b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103925) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 18:03:24.147649 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG dbcounter [-] [103925] Writer thread running {{(pid=103925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 18:03:24.194458 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.context [None req-754e7e4e-a387-4e97-ad03-0d369d224d16 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e78b579e-79d5-47c3-990c-b247b1ada0c9(cell1) {{(pid=103924) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 18:03:24.198987 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG oslo_concurrency.lockutils [None req-754e7e4e-a387-4e97-ad03-0d369d224d16 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:24.200568 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG oslo_concurrency.lockutils [None req-754e7e4e-a387-4e97-ad03-0d369d224d16 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:24.201409 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG oslo_concurrency.lockutils [None req-754e7e4e-a387-4e97-ad03-0d369d224d16 None None] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:24.202789 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.context [None req-14918635-acbb-4a0f-a9f2-1e68db25590b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e78b579e-79d5-47c3-990c-b247b1ada0c9(cell1) {{(pid=103925) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 18:03:24.203382 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG oslo_concurrency.lockutils [None req-754e7e4e-a387-4e97-ad03-0d369d224d16 None None] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:24.205399 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: INFO dbcounter [None req-754e7e4e-a387-4e97-ad03-0d369d224d16 None None] Registered counter for database nova_cell0 Jul 28 18:03:24.206728 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG oslo_concurrency.lockutils [None req-14918635-acbb-4a0f-a9f2-1e68db25590b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:24.208352 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG oslo_concurrency.lockutils [None req-14918635-acbb-4a0f-a9f2-1e68db25590b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:24.209252 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG oslo_concurrency.lockutils [None req-14918635-acbb-4a0f-a9f2-1e68db25590b None None] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:24.210740 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: INFO dbcounter [None req-754e7e4e-a387-4e97-ad03-0d369d224d16 None None] Registered counter for database nova_cell1 Jul 28 18:03:24.211311 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG oslo_concurrency.lockutils [None req-14918635-acbb-4a0f-a9f2-1e68db25590b None None] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:24.213477 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: INFO dbcounter [None req-14918635-acbb-4a0f-a9f2-1e68db25590b None None] Registered counter for database nova_cell0 Jul 28 18:03:24.218745 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG oslo_db.sqlalchemy.engines [None req-754e7e4e-a387-4e97-ad03-0d369d224d16 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103924) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 18:03:24.219280 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: INFO dbcounter [None req-14918635-acbb-4a0f-a9f2-1e68db25590b None None] Registered counter for database nova_cell1 Jul 28 18:03:24.220597 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG oslo_db.sqlalchemy.engines [None req-754e7e4e-a387-4e97-ad03-0d369d224d16 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103924) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 18:03:24.226179 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG dbcounter [-] [103924] Writer thread running {{(pid=103924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 18:03:24.226557 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG oslo_db.sqlalchemy.engines [None req-14918635-acbb-4a0f-a9f2-1e68db25590b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103925) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 18:03:24.227896 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG oslo_db.sqlalchemy.engines [None req-14918635-acbb-4a0f-a9f2-1e68db25590b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103925) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 18:03:24.234367 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG dbcounter [-] [103925] Writer thread running {{(pid=103925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 18:03:24.236613 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG dbcounter [-] [103925] Writer thread running {{(pid=103925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 18:03:24.363144 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG dbcounter [-] [103924] Writer thread running {{(pid=103924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 18:03:24.373640 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: INFO dbcounter [None req-754e7e4e-a387-4e97-ad03-0d369d224d16 None None] Registered counter for database nova_cell0 Jul 28 18:03:24.383193 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG oslo_db.sqlalchemy.engines [None req-754e7e4e-a387-4e97-ad03-0d369d224d16 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103924) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 18:03:24.385414 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: INFO dbcounter [None req-14918635-acbb-4a0f-a9f2-1e68db25590b None None] Registered counter for database nova_cell0 Jul 28 18:03:24.389222 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG dbcounter [-] [103924] Writer thread running {{(pid=103924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 18:03:24.392019 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG oslo_db.sqlalchemy.engines [None req-14918635-acbb-4a0f-a9f2-1e68db25590b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103925) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 18:03:24.397040 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG dbcounter [-] [103925] Writer thread running {{(pid=103925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 18:03:24.833821 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: WARNING keystonemiddleware.auth_token [None req-754e7e4e-a387-4e97-ad03-0d369d224d16 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 18:03:24.841769 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: WARNING keystonemiddleware.auth_token [None req-754e7e4e-a387-4e97-ad03-0d369d224d16 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 18:03:24.857877 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: WARNING keystonemiddleware.auth_token [None req-14918635-acbb-4a0f-a9f2-1e68db25590b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 18:03:24.865342 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: WARNING keystonemiddleware.auth_token [None req-14918635-acbb-4a0f-a9f2-1e68db25590b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 18:03:25.180797 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: WARNING keystonemiddleware.auth_token [None req-754e7e4e-a387-4e97-ad03-0d369d224d16 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 18:03:25.186823 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: WARNING keystonemiddleware.auth_token [None req-754e7e4e-a387-4e97-ad03-0d369d224d16 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 18:03:25.192104 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564bb50179c0 pid: 103924 (default app) Jul 28 18:03:25.194218 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi [None req-754e7e4e-a387-4e97-ad03-0d369d224d16 None None] Calling method '>' {{(pid=103924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:03:25.195399 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: INFO nova.api.openstack.requestlog [None req-754e7e4e-a387-4e97-ad03-0d369d224d16 None None] 10.222.0.86 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001738 Jul 28 18:03:25.196103 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: [pid: 103924|app: 0|req: 1/1] 10.222.0.86 () {50 vars in 788 bytes} [Thu Jul 28 18:03:25 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:03:25.219655 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: WARNING keystonemiddleware.auth_token [None req-14918635-acbb-4a0f-a9f2-1e68db25590b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 18:03:25.225604 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: WARNING keystonemiddleware.auth_token [None req-14918635-acbb-4a0f-a9f2-1e68db25590b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 18:03:25.230878 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564bb50179c0 pid: 103925 (default app) Jul 28 18:04:44.210563 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi [None req-754e7e4e-a387-4e97-ad03-0d369d224d16 None None] Calling method '>' {{(pid=103924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:44.215867 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: INFO nova.api.openstack.requestlog [None req-754e7e4e-a387-4e97-ad03-0d369d224d16 None None] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001994 Jul 28 18:04:44.215867 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: [pid: 103924|app: 0|req: 2/2] 10.222.0.86 () {54 vars in 930 bytes} [Thu Jul 28 18:04:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:04:44.225078 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG dbcounter [-] [103925] Writing DB stats nova_api:SELECT=3 {{(pid=103925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:04:44.226251 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG dbcounter [-] [103925] Writing DB stats nova_cell1:SELECT=3 {{(pid=103925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:04:44.227176 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG dbcounter [-] [103925] Writing DB stats nova_cell0:SELECT=3 {{(pid=103925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:04:44.228704 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG dbcounter [-] [103925] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:04:45.115030 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi [None req-2612f30e-b4b3-4d95-a152-47e601bf279f admin admin] Calling method '>' {{(pid=103925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:45.146633 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: INFO nova.api.openstack.requestlog [None req-2612f30e-b4b3-4d95-a152-47e601bf279f admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.926750 Jul 28 18:04:45.147372 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: [pid: 103925|app: 0|req: 1/3] 10.222.0.86 () {60 vars in 1291 bytes} [Thu Jul 28 18:04:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:47.373458 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi [None req-754e7e4e-a387-4e97-ad03-0d369d224d16 None None] Calling method '>' {{(pid=103924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:47.374978 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: INFO nova.api.openstack.requestlog [None req-754e7e4e-a387-4e97-ad03-0d369d224d16 None None] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002224 Jul 28 18:04:47.375554 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: [pid: 103924|app: 0|req: 3/4] 10.222.0.86 () {54 vars in 930 bytes} [Thu Jul 28 18:04:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:04:47.864746 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi [None req-c68696ca-3e1a-40f9-a6f1-47e4c28e847e admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "id": "c1", "ram": 256, "os-flavor-access:is_public": true}} {{(pid=103925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:04:47.886986 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 18:04:47.886986 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: warnings.warn(msg) Jul 28 18:04:47.970098 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: INFO nova.api.openstack.requestlog [None req-c68696ca-3e1a-40f9-a6f1-47e4c28e847e admin admin] 10.222.0.86 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.587340 Jul 28 18:04:47.977756 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: [pid: 103925|app: 0|req: 2/5] 10.222.0.86 () {64 vars in 1282 bytes} [Thu Jul 28 18:04:47 2022] POST /compute/v2.1/flavors => generated 407 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 18:04:47.985531 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG dbcounter [-] [103924] Writing DB stats nova_api:SELECT=3 {{(pid=103924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:04:47.986702 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG dbcounter [-] [103924] Writing DB stats nova_cell1:SELECT=3 {{(pid=103924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:04:47.987811 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG dbcounter [-] [103924] Writing DB stats nova_cell0:SELECT=3 {{(pid=103924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:04:47.988600 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG dbcounter [-] [103924] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:04:48.198367 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi [None req-31167e7f-bd3c-4815-b0d4-d35002542fee admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:04:48.202700 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 18:04:48.202700 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: warnings.warn(msg) Jul 28 18:04:48.304108 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: INFO nova.api.openstack.requestlog [None req-31167e7f-bd3c-4815-b0d4-d35002542fee admin admin] 10.222.0.86 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.324611 Jul 28 18:04:48.304887 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: [pid: 103924|app: 0|req: 4/6] 10.222.0.86 () {64 vars in 1335 bytes} [Thu Jul 28 18:04:47 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:50.578587 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi [None req-c68696ca-3e1a-40f9-a6f1-47e4c28e847e admin admin] Calling method '>' {{(pid=103925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:50.579606 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: INFO nova.api.openstack.requestlog [None req-c68696ca-3e1a-40f9-a6f1-47e4c28e847e admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Jul 28 18:04:50.580008 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: [pid: 103925|app: 0|req: 3/7] 10.222.0.86 () {54 vars in 930 bytes} [Thu Jul 28 18:04:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:04:51.224694 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi [None req-8d773ecf-ab57-498c-8364-778fb40598da admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "rxtx_factor": 1.0, "swap": 0, "id": "d1", "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "disk": 5}} {{(pid=103924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:04:51.245587 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 18:04:51.245587 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: warnings.warn(msg) Jul 28 18:04:51.355095 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: INFO nova.api.openstack.requestlog [None req-8d773ecf-ab57-498c-8364-778fb40598da admin admin] 10.222.0.86 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.769042 Jul 28 18:04:51.355899 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: [pid: 103924|app: 0|req: 5/8] 10.222.0.86 () {64 vars in 1282 bytes} [Thu Jul 28 18:04:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 18:04:51.368115 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi [None req-65698ce1-fc9c-484f-9026-2f6a7f302de6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:04:51.370978 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 18:04:51.370978 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: warnings.warn(msg) Jul 28 18:04:51.491156 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: INFO nova.api.openstack.requestlog [None req-65698ce1-fc9c-484f-9026-2f6a7f302de6 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.126960 Jul 28 18:04:51.491930 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: [pid: 103925|app: 0|req: 4/9] 10.222.0.86 () {64 vars in 1335 bytes} [Thu Jul 28 18:04:51 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:53.701305 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi [None req-8d773ecf-ab57-498c-8364-778fb40598da admin admin] Calling method '>' {{(pid=103924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:53.701922 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: INFO nova.api.openstack.requestlog [None req-8d773ecf-ab57-498c-8364-778fb40598da admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Jul 28 18:04:53.702481 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: [pid: 103924|app: 0|req: 6/10] 10.222.0.86 () {54 vars in 930 bytes} [Thu Jul 28 18:04:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:04:54.111857 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi [None req-caff3165-1392-450a-88e5-f45488ba8a01 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "ram": 1024, "id": "d2", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0}} {{(pid=103925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:04:54.189149 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: INFO nova.api.openstack.requestlog [None req-caff3165-1392-450a-88e5-f45488ba8a01 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.480750 Jul 28 18:04:54.189655 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: [pid: 103925|app: 0|req: 5/11] 10.222.0.86 () {64 vars in 1282 bytes} [Thu Jul 28 18:04:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 18:04:54.202392 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi [None req-682bf988-b8ea-4575-80c5-f1b0b68c24d9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:04:54.295760 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: INFO nova.api.openstack.requestlog [None req-682bf988-b8ea-4575-80c5-f1b0b68c24d9 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097437 Jul 28 18:04:54.296340 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: [pid: 103924|app: 0|req: 7/12] 10.222.0.86 () {64 vars in 1335 bytes} [Thu Jul 28 18:04:54 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:04:56.491165 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi [None req-caff3165-1392-450a-88e5-f45488ba8a01 admin admin] Calling method '>' {{(pid=103925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:56.492187 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: INFO nova.api.openstack.requestlog [None req-caff3165-1392-450a-88e5-f45488ba8a01 admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Jul 28 18:04:56.492595 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: [pid: 103925|app: 0|req: 6/13] 10.222.0.86 () {54 vars in 930 bytes} [Thu Jul 28 18:04:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:04:56.917637 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi [None req-ec3ba379-7cbc-4f59-a47f-69cf9f2ebfe9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "ram": 2048, "os-flavor-access:is_public": true, "swap": 0, "disk": 10, "rxtx_factor": 1.0, "id": "d3", "name": "ds2G"}} {{(pid=103924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:04:57.020036 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: INFO nova.api.openstack.requestlog [None req-ec3ba379-7cbc-4f59-a47f-69cf9f2ebfe9 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.520157 Jul 28 18:04:57.021902 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: [pid: 103924|app: 0|req: 8/14] 10.222.0.86 () {64 vars in 1282 bytes} [Thu Jul 28 18:04:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 18:04:57.037527 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi [None req-35ee8805-49f5-48c2-a444-38d296df49da admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:04:57.147988 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: INFO nova.api.openstack.requestlog [None req-35ee8805-49f5-48c2-a444-38d296df49da admin admin] 10.222.0.86 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.115911 Jul 28 18:04:57.148495 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: [pid: 103925|app: 0|req: 7/15] 10.222.0.86 () {64 vars in 1335 bytes} [Thu Jul 28 18:04:57 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:59.352042 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi [None req-ec3ba379-7cbc-4f59-a47f-69cf9f2ebfe9 admin admin] Calling method '>' {{(pid=103924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:59.363776 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: INFO nova.api.openstack.requestlog [None req-ec3ba379-7cbc-4f59-a47f-69cf9f2ebfe9 admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003038 Jul 28 18:04:59.363776 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: [pid: 103924|app: 0|req: 9/16] 10.222.0.86 () {54 vars in 930 bytes} [Thu Jul 28 18:04:59 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:04:59.804509 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi [None req-b7874a43-6fa9-4c8f-9b1e-ca1927a4382d admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "vcpus": 4, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "os-flavor-access:is_public": true, "name": "ds4G", "id": "d4"}} {{(pid=103925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:04:59.887400 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: INFO nova.api.openstack.requestlog [None req-b7874a43-6fa9-4c8f-9b1e-ca1927a4382d admin admin] 10.222.0.86 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.526126 Jul 28 18:04:59.889263 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: [pid: 103925|app: 0|req: 8/17] 10.222.0.86 () {64 vars in 1282 bytes} [Thu Jul 28 18:04:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 18:04:59.901502 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi [None req-5d978846-b308-4b77-a092-011961922308 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:05:00.008079 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: INFO nova.api.openstack.requestlog [None req-5d978846-b308-4b77-a092-011961922308 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.110218 Jul 28 18:05:00.009777 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: [pid: 103924|app: 0|req: 10/18] 10.222.0.86 () {64 vars in 1335 bytes} [Thu Jul 28 18:04:59 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:05:02.239522 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi [None req-b7874a43-6fa9-4c8f-9b1e-ca1927a4382d admin admin] Calling method '>' {{(pid=103925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:02.240582 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: INFO nova.api.openstack.requestlog [None req-b7874a43-6fa9-4c8f-9b1e-ca1927a4382d admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Jul 28 18:05:02.241041 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: [pid: 103925|app: 0|req: 9/19] 10.222.0.86 () {54 vars in 930 bytes} [Thu Jul 28 18:05:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:05:02.662519 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi [None req-e1d5d5f6-1c4a-45f2-8341-46b80f1c9a8e admin admin] Calling method '>' {{(pid=103924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:02.687284 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: INFO nova.api.openstack.requestlog [None req-e1d5d5f6-1c4a-45f2-8341-46b80f1c9a8e admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.439837 Jul 28 18:05:02.687823 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: [pid: 103924|app: 0|req: 11/20] 10.222.0.86 () {60 vars in 1291 bytes} [Thu Jul 28 18:05:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:05:05.811511 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi [None req-b7874a43-6fa9-4c8f-9b1e-ca1927a4382d admin admin] Calling method '>' {{(pid=103925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:05.812559 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: INFO nova.api.openstack.requestlog [None req-b7874a43-6fa9-4c8f-9b1e-ca1927a4382d admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Jul 28 18:05:05.813015 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: [pid: 103925|app: 0|req: 10/21] 10.222.0.86 () {54 vars in 930 bytes} [Thu Jul 28 18:05:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:05:06.264215 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi [None req-5125835d-0ec9-4dec-bb17-b7a9867064fe admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "ram": 512, "os-flavor-access:is_public": true, "disk": 1, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "1"}} {{(pid=103924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:05:06.385065 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: INFO nova.api.openstack.requestlog [None req-5125835d-0ec9-4dec-bb17-b7a9867064fe admin admin] 10.222.0.86 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.564482 Jul 28 18:05:06.385980 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: [pid: 103924|app: 0|req: 12/22] 10.222.0.86 () {64 vars in 1282 bytes} [Thu Jul 28 18:05:05 2022] POST /compute/v2.1/flavors => generated 402 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 18:05:06.398173 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi [None req-b495e3f6-f36b-44ac-8fce-53fba5954cc9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:05:06.507047 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: INFO nova.api.openstack.requestlog [None req-b495e3f6-f36b-44ac-8fce-53fba5954cc9 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.112529 Jul 28 18:05:06.507547 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: [pid: 103925|app: 0|req: 11/23] 10.222.0.86 () {64 vars in 1332 bytes} [Thu Jul 28 18:05:06 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:05:08.692049 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi [None req-5125835d-0ec9-4dec-bb17-b7a9867064fe admin admin] Calling method '>' {{(pid=103924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:08.693018 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: INFO nova.api.openstack.requestlog [None req-5125835d-0ec9-4dec-bb17-b7a9867064fe admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Jul 28 18:05:08.693428 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: [pid: 103924|app: 0|req: 13/24] 10.222.0.86 () {54 vars in 930 bytes} [Thu Jul 28 18:05:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:05:09.116234 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi [None req-7a64d2d5-ac65-4f7b-b839-7bf031e2eb29 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "id": "2", "vcpus": 1, "name": "m1.small", "os-flavor-access:is_public": true, "disk": 20, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:05:09.198240 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: INFO nova.api.openstack.requestlog [None req-7a64d2d5-ac65-4f7b-b839-7bf031e2eb29 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.498392 Jul 28 18:05:09.198808 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: [pid: 103925|app: 0|req: 12/25] 10.222.0.86 () {64 vars in 1282 bytes} [Thu Jul 28 18:05:08 2022] POST /compute/v2.1/flavors => generated 405 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 18:05:09.216391 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi [None req-e4d74ca9-c64e-4fbb-9a69-cff5dcda503f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:05:09.309031 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: INFO nova.api.openstack.requestlog [None req-e4d74ca9-c64e-4fbb-9a69-cff5dcda503f admin admin] 10.222.0.86 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.101802 Jul 28 18:05:09.313832 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: [pid: 103924|app: 0|req: 14/26] 10.222.0.86 () {64 vars in 1332 bytes} [Thu Jul 28 18:05:09 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:05:11.519137 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi [None req-7a64d2d5-ac65-4f7b-b839-7bf031e2eb29 admin admin] Calling method '>' {{(pid=103925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:11.520155 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: INFO nova.api.openstack.requestlog [None req-7a64d2d5-ac65-4f7b-b839-7bf031e2eb29 admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Jul 28 18:05:11.520637 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: [pid: 103925|app: 0|req: 13/27] 10.222.0.86 () {54 vars in 930 bytes} [Thu Jul 28 18:05:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:05:11.936989 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi [None req-0cdeca9d-8e6a-441e-9817-351f1b184ff4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 40, "vcpus": 2, "ram": 4096, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "3", "rxtx_factor": 1.0}} {{(pid=103924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:05:12.016782 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: INFO nova.api.openstack.requestlog [None req-0cdeca9d-8e6a-441e-9817-351f1b184ff4 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.490255 Jul 28 18:05:12.017371 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: [pid: 103924|app: 0|req: 15/28] 10.222.0.86 () {64 vars in 1282 bytes} [Thu Jul 28 18:05:11 2022] POST /compute/v2.1/flavors => generated 406 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 18:05:12.029717 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi [None req-ea8b8252-39a2-470a-8d74-50127f14396e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:05:12.142195 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: INFO nova.api.openstack.requestlog [None req-ea8b8252-39a2-470a-8d74-50127f14396e admin admin] 10.222.0.86 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.116092 Jul 28 18:05:12.154091 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: [pid: 103925|app: 0|req: 14/29] 10.222.0.86 () {64 vars in 1332 bytes} [Thu Jul 28 18:05:12 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:05:14.444709 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi [None req-0cdeca9d-8e6a-441e-9817-351f1b184ff4 admin admin] Calling method '>' {{(pid=103924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:14.446235 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: INFO nova.api.openstack.requestlog [None req-0cdeca9d-8e6a-441e-9817-351f1b184ff4 admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002218 Jul 28 18:05:14.446854 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: [pid: 103924|app: 0|req: 16/30] 10.222.0.86 () {54 vars in 930 bytes} [Thu Jul 28 18:05:14 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:05:14.968051 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi [None req-b45e8a8a-24b6-4174-bf5c-27375a23961a admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "disk": 80, "name": "m1.large", "swap": 0, "os-flavor-access:is_public": true, "vcpus": 4}} {{(pid=103925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:05:14.975765 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG dbcounter [-] [103925] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:15.066232 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: INFO nova.api.openstack.requestlog [None req-b45e8a8a-24b6-4174-bf5c-27375a23961a admin admin] 10.222.0.86 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.611008 Jul 28 18:05:15.067347 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: [pid: 103925|app: 0|req: 15/31] 10.222.0.86 () {64 vars in 1282 bytes} [Thu Jul 28 18:05:14 2022] POST /compute/v2.1/flavors => generated 405 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 18:05:15.079239 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi [None req-ee6e14fd-7078-4689-99c1-c58dfe23508a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:05:15.217042 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: INFO nova.api.openstack.requestlog [None req-ee6e14fd-7078-4689-99c1-c58dfe23508a admin admin] 10.222.0.86 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.141354 Jul 28 18:05:15.217634 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: [pid: 103924|app: 0|req: 17/32] 10.222.0.86 () {64 vars in 1332 bytes} [Thu Jul 28 18:05:15 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:05:17.505663 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi [None req-b45e8a8a-24b6-4174-bf5c-27375a23961a admin admin] Calling method '>' {{(pid=103925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:17.505663 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: INFO nova.api.openstack.requestlog [None req-b45e8a8a-24b6-4174-bf5c-27375a23961a admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001629 Jul 28 18:05:17.511646 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: [pid: 103925|app: 0|req: 16/33] 10.222.0.86 () {54 vars in 930 bytes} [Thu Jul 28 18:05:17 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:05:17.972526 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi [None req-9b6393af-b8bd-4b2c-bf3c-71176d594346 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "disk": 160, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "vcpus": 8, "os-flavor-access:is_public": true, "ram": 16384, "swap": 0}} {{(pid=103924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:05:18.046729 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: INFO nova.api.openstack.requestlog [None req-9b6393af-b8bd-4b2c-bf3c-71176d594346 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.533775 Jul 28 18:05:18.047466 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: [pid: 103924|app: 0|req: 18/34] 10.222.0.86 () {64 vars in 1282 bytes} [Thu Jul 28 18:05:17 2022] POST /compute/v2.1/flavors => generated 408 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 18:05:18.060121 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi [None req-8e4bab08-21fe-4ca5-906e-54123055f878 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:05:18.128265 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: INFO nova.api.openstack.requestlog [None req-8e4bab08-21fe-4ca5-906e-54123055f878 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.072485 Jul 28 18:05:18.129170 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: [pid: 103925|app: 0|req: 17/35] 10.222.0.86 () {64 vars in 1332 bytes} [Thu Jul 28 18:05:18 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:05:38.698659 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi [None req-9b6393af-b8bd-4b2c-bf3c-71176d594346 admin admin] Calling method '>' {{(pid=103924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:38.699651 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: INFO nova.api.openstack.requestlog [None req-9b6393af-b8bd-4b2c-bf3c-71176d594346 admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Jul 28 18:05:38.700060 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: [pid: 103924|app: 0|req: 19/36] 10.222.0.86 () {54 vars in 930 bytes} [Thu Jul 28 18:05:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:05:39.087493 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi [None req-86c3f09b-aa7d-4696-96a7-433c05e0609a admin admin] Calling method '>' {{(pid=103925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:39.105240 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: INFO nova.api.openstack.requestlog [None req-86c3f09b-aa7d-4696-96a7-433c05e0609a admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.399262 Jul 28 18:05:39.105775 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: [pid: 103925|app: 0|req: 18/37] 10.222.0.86 () {60 vars in 1291 bytes} [Thu Jul 28 18:05:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:05:40.200322 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi [None req-9b6393af-b8bd-4b2c-bf3c-71176d594346 admin admin] Calling method '>' {{(pid=103924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:40.201374 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: INFO nova.api.openstack.requestlog [None req-9b6393af-b8bd-4b2c-bf3c-71176d594346 admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jul 28 18:05:40.201774 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: [pid: 103924|app: 0|req: 20/38] 10.222.0.86 () {56 vars in 1074 bytes} [Thu Jul 28 18:05:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:05:40.728787 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi [None req-bb4ddc1a-980e-40d4-b460-bb48667df8ff admin admin] Calling method '>' {{(pid=103925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:40.734670 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: INFO nova.api.openstack.wsgi [None req-bb4ddc1a-980e-40d4-b460-bb48667df8ff admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 28 18:05:40.738012 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi [None req-bb4ddc1a-980e-40d4-b460-bb48667df8ff admin admin] Request method failure captured: Jul 28 18:05:40.738012 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 28 18:05:40.738012 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: Accept: application/json Jul 28 18:05:40.738012 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: Accept-Encoding: gzip, deflate Jul 28 18:05:40.738012 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: Connection: keep-alive Jul 28 18:05:40.738012 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: Content-Length: 0 Jul 28 18:05:40.738012 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: Host: 10.222.0.86 Jul 28 18:05:40.738012 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: Openstack-Api-Version: compute 2.90 Jul 28 18:05:40.738012 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: Openstack-System-Scope: None Jul 28 18:05:40.738012 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: User-Agent: python-novaclient Jul 28 18:05:40.738012 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: X-Auth-Token: gAAAAABi4s_0OM31NuWHOorNa0jamm216-YyF_R0EmhPVXCvau3s7dtAhjEicjksEEcWR4YPS5ZJ3SuzziW4f-GEVWy-bqmDv5QhUMHdUxOgORGRzk0HUEK8wyHQsqcoTMbAk_9HgKNZ6Al8nubPA5FV6GfW-KbydZ26Hckc7AzevljxvPoxZ9A Jul 28 18:05:40.738012 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: X-Domain-Id: None Jul 28 18:05:40.738012 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: X-Domain-Name: None Jul 28 18:05:40.738012 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: X-Identity-Status: Confirmed Jul 28 18:05:40.738012 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: X-Is-Admin-Project: True Jul 28 18:05:40.738012 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 18:05:40.738012 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: X-Project-Domain-Id: default Jul 28 18:05:40.738012 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: X-Project-Domain-Name: Default Jul 28 18:05:40.738012 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: X-Project-Id: e2f95f7ebd0046e996236ac2938731ae Jul 28 18:05:40.738012 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: X-Project-Name: admin Jul 28 18:05:40.738012 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: X-Role: member,admin,reader Jul 28 18:05:40.738012 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: X-Roles: member,admin,reader Jul 28 18:05:40.739605 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_e2f95f7ebd0046e996236ac2938731ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/e2f95f7ebd0046e996236ac2938731ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/e2f95f7ebd0046e996236ac2938731ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/e2f95f7ebd0046e996236ac2938731ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}] Jul 28 18:05:40.739605 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: X-Tenant: admin Jul 28 18:05:40.739605 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: X-Tenant-Id: e2f95f7ebd0046e996236ac2938731ae Jul 28 18:05:40.739605 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: X-Tenant-Name: admin Jul 28 18:05:40.739605 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: X-User: admin Jul 28 18:05:40.739605 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: X-User-Domain-Id: default Jul 28 18:05:40.739605 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: X-User-Domain-Name: Default Jul 28 18:05:40.739605 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: X-User-Id: 1dff148688b84b08aaa5c8689269444f Jul 28 18:05:40.739605 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: X-User-Name: admin Jul 28 18:05:40.739605 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: method: > Jul 28 18:05:40.739605 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: exception: Flavor 42 could not be found. Jul 28 18:05:40.739605 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: action_args: {'id': '42'} Jul 28 18:05:40.739605 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: {{(pid=103925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:05:40.739605 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:05:40.740678 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 18:05:40.740678 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 18:05:40.740678 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 18:05:40.740678 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 18:05:40.740678 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 18:05:40.740678 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 18:05:40.740678 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 18:05:40.740678 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 18:05:40.740678 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 18:05:40.740678 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:05:40.740678 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 18:05:40.740678 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 18:05:40.740678 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 28 18:05:40.740678 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi Jul 28 18:05:40.740678 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:05:40.740678 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi Jul 28 18:05:40.740678 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:05:40.740678 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:05:40.740678 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:05:40.742174 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:05:40.742174 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:05:40.742174 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:05:40.742174 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:05:40.742174 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 18:05:40.742174 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:05:40.742174 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 28 18:05:40.742174 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi Jul 28 18:05:40.742174 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:05:40.742174 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi Jul 28 18:05:40.742174 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:05:40.742174 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:05:40.742174 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:05:40.742174 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:05:40.742174 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:05:40.742174 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 28 18:05:40.742174 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi Jul 28 18:05:40.742174 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi [None req-bb4ddc1a-980e-40d4-b460-bb48667df8ff admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103925) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:05:40.743530 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: INFO nova.api.openstack.requestlog [None req-bb4ddc1a-980e-40d4-b460-bb48667df8ff admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.394948 Jul 28 18:05:40.743530 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: [pid: 103925|app: 0|req: 19/39] 10.222.0.86 () {60 vars in 1190 bytes} [Thu Jul 28 18:05:40 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 18:05:40.749258 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi [None req-ec9c4b37-4100-473e-b76d-e972516e2384 admin admin] Calling method '>' {{(pid=103924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:40.753582 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG dbcounter [-] [103924] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:40.772224 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: INFO nova.api.openstack.requestlog [None req-ec9c4b37-4100-473e-b76d-e972516e2384 admin admin] 10.222.0.86 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026459 Jul 28 18:05:40.772791 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: [pid: 103924|app: 0|req: 21/40] 10.222.0.86 () {60 vars in 1210 bytes} [Thu Jul 28 18:05:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:05:40.782963 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi [None req-2a3ceb49-1e4b-4590-91df-e616c0ce000f admin admin] Calling method '>' {{(pid=103925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:40.806907 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: INFO nova.api.openstack.requestlog [None req-2a3ceb49-1e4b-4590-91df-e616c0ce000f admin admin] 10.222.0.86 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027529 Jul 28 18:05:40.807451 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: [pid: 103925|app: 0|req: 20/41] 10.222.0.86 () {60 vars in 1210 bytes} [Thu Jul 28 18:05:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:05:40.817119 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi [None req-16d1d226-e758-4141-b4b6-0ac0b57b3043 admin admin] Calling method '>' {{(pid=103924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:40.822864 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: INFO nova.api.openstack.wsgi [None req-16d1d226-e758-4141-b4b6-0ac0b57b3043 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 28 18:05:40.826259 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi [None req-16d1d226-e758-4141-b4b6-0ac0b57b3043 admin admin] Request method failure captured: Jul 28 18:05:40.826259 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 28 18:05:40.826259 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: Accept: application/json Jul 28 18:05:40.826259 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: Accept-Encoding: gzip, deflate Jul 28 18:05:40.826259 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: Connection: keep-alive Jul 28 18:05:40.826259 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: Content-Length: 0 Jul 28 18:05:40.826259 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: Host: 10.222.0.86 Jul 28 18:05:40.826259 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: Openstack-Api-Version: compute 2.90 Jul 28 18:05:40.826259 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: Openstack-System-Scope: None Jul 28 18:05:40.826259 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: User-Agent: python-novaclient Jul 28 18:05:40.826259 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: X-Auth-Token: gAAAAABi4s_0OM31NuWHOorNa0jamm216-YyF_R0EmhPVXCvau3s7dtAhjEicjksEEcWR4YPS5ZJ3SuzziW4f-GEVWy-bqmDv5QhUMHdUxOgORGRzk0HUEK8wyHQsqcoTMbAk_9HgKNZ6Al8nubPA5FV6GfW-KbydZ26Hckc7AzevljxvPoxZ9A Jul 28 18:05:40.826259 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: X-Domain-Id: None Jul 28 18:05:40.826259 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: X-Domain-Name: None Jul 28 18:05:40.826259 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: X-Identity-Status: Confirmed Jul 28 18:05:40.826259 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: X-Is-Admin-Project: True Jul 28 18:05:40.826259 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 18:05:40.826259 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: X-Project-Domain-Id: default Jul 28 18:05:40.826259 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: X-Project-Domain-Name: Default Jul 28 18:05:40.826259 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: X-Project-Id: e2f95f7ebd0046e996236ac2938731ae Jul 28 18:05:40.826259 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: X-Project-Name: admin Jul 28 18:05:40.826259 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: X-Role: member,admin,reader Jul 28 18:05:40.826259 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: X-Roles: member,admin,reader Jul 28 18:05:40.827830 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_e2f95f7ebd0046e996236ac2938731ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/e2f95f7ebd0046e996236ac2938731ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/e2f95f7ebd0046e996236ac2938731ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/e2f95f7ebd0046e996236ac2938731ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}] Jul 28 18:05:40.827830 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: X-Tenant: admin Jul 28 18:05:40.827830 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: X-Tenant-Id: e2f95f7ebd0046e996236ac2938731ae Jul 28 18:05:40.827830 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: X-Tenant-Name: admin Jul 28 18:05:40.827830 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: X-User: admin Jul 28 18:05:40.827830 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: X-User-Domain-Id: default Jul 28 18:05:40.827830 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: X-User-Domain-Name: Default Jul 28 18:05:40.827830 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: X-User-Id: 1dff148688b84b08aaa5c8689269444f Jul 28 18:05:40.827830 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: X-User-Name: admin Jul 28 18:05:40.827830 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: method: > Jul 28 18:05:40.827830 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: exception: Flavor 42 could not be found. Jul 28 18:05:40.827830 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: action_args: {'id': '42'} Jul 28 18:05:40.827830 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: {{(pid=103924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:05:40.827830 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:05:40.829873 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 18:05:40.829873 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 18:05:40.829873 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 18:05:40.829873 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 18:05:40.829873 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 18:05:40.829873 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 18:05:40.829873 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 18:05:40.829873 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 18:05:40.829873 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 18:05:40.829873 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:05:40.829873 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 18:05:40.829873 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 18:05:40.829873 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 28 18:05:40.829873 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi Jul 28 18:05:40.829873 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:05:40.829873 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi Jul 28 18:05:40.829873 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:05:40.829873 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:05:40.829873 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:05:40.830977 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:05:40.830977 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:05:40.830977 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:05:40.830977 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:05:40.830977 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 18:05:40.830977 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:05:40.830977 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 28 18:05:40.830977 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi Jul 28 18:05:40.830977 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:05:40.830977 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi Jul 28 18:05:40.830977 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:05:40.830977 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:05:40.830977 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:05:40.830977 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:05:40.830977 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:05:40.830977 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 28 18:05:40.830977 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi Jul 28 18:05:40.830977 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi [None req-16d1d226-e758-4141-b4b6-0ac0b57b3043 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:05:40.832077 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: INFO nova.api.openstack.requestlog [None req-16d1d226-e758-4141-b4b6-0ac0b57b3043 admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014438 Jul 28 18:05:40.832077 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: [pid: 103924|app: 0|req: 22/42] 10.222.0.86 () {60 vars in 1190 bytes} [Thu Jul 28 18:05:40 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 28 18:05:41.806193 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi [None req-2a3ceb49-1e4b-4590-91df-e616c0ce000f admin admin] Calling method '>' {{(pid=103925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:41.807200 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: INFO nova.api.openstack.requestlog [None req-2a3ceb49-1e4b-4590-91df-e616c0ce000f admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Jul 28 18:05:41.807591 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: [pid: 103925|app: 0|req: 21/43] 10.222.0.86 () {56 vars in 1074 bytes} [Thu Jul 28 18:05:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:05:42.356831 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi [None req-0bbb0a98-13d5-49d1-ba1c-31e08af623ba admin admin] Calling method '>' {{(pid=103924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:42.362426 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: INFO nova.api.openstack.wsgi [None req-0bbb0a98-13d5-49d1-ba1c-31e08af623ba admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 28 18:05:42.363952 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi [None req-0bbb0a98-13d5-49d1-ba1c-31e08af623ba admin admin] Request method failure captured: Jul 28 18:05:42.363952 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 28 18:05:42.363952 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: Accept: application/json Jul 28 18:05:42.363952 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: Accept-Encoding: gzip, deflate Jul 28 18:05:42.363952 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: Connection: keep-alive Jul 28 18:05:42.363952 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: Content-Length: 0 Jul 28 18:05:42.363952 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: Host: 10.222.0.86 Jul 28 18:05:42.363952 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: Openstack-Api-Version: compute 2.90 Jul 28 18:05:42.363952 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: Openstack-System-Scope: None Jul 28 18:05:42.363952 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: User-Agent: python-novaclient Jul 28 18:05:42.363952 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: X-Auth-Token: gAAAAABi4s_1i4tSMmuwI7jSRtqdJI6vnmjAnHFeidmUGNm7zQqsEEuoVCOn4_9bBXfuwCqnSVpN8XXL7BUTGpVJEnWl7pzX5KazgyZQHPpeH-iXDjh__eJZ5aUa3cxLUcCMHKWLC7I75-6aNiDoCjnqfgQBJniE8jRDpW9lTmcxH4XK6_1Vc68 Jul 28 18:05:42.363952 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: X-Domain-Id: None Jul 28 18:05:42.363952 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: X-Domain-Name: None Jul 28 18:05:42.363952 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: X-Identity-Status: Confirmed Jul 28 18:05:42.363952 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: X-Is-Admin-Project: True Jul 28 18:05:42.363952 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 18:05:42.363952 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: X-Project-Domain-Id: default Jul 28 18:05:42.363952 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: X-Project-Domain-Name: Default Jul 28 18:05:42.363952 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: X-Project-Id: e2f95f7ebd0046e996236ac2938731ae Jul 28 18:05:42.363952 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: X-Project-Name: admin Jul 28 18:05:42.363952 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: X-Role: member,admin,reader Jul 28 18:05:42.363952 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: X-Roles: member,admin,reader Jul 28 18:05:42.365891 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_e2f95f7ebd0046e996236ac2938731ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/e2f95f7ebd0046e996236ac2938731ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/e2f95f7ebd0046e996236ac2938731ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/e2f95f7ebd0046e996236ac2938731ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}] Jul 28 18:05:42.365891 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: X-Tenant: admin Jul 28 18:05:42.365891 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: X-Tenant-Id: e2f95f7ebd0046e996236ac2938731ae Jul 28 18:05:42.365891 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: X-Tenant-Name: admin Jul 28 18:05:42.365891 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: X-User: admin Jul 28 18:05:42.365891 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: X-User-Domain-Id: default Jul 28 18:05:42.365891 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: X-User-Domain-Name: Default Jul 28 18:05:42.365891 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: X-User-Id: 1dff148688b84b08aaa5c8689269444f Jul 28 18:05:42.365891 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: X-User-Name: admin Jul 28 18:05:42.365891 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: method: > Jul 28 18:05:42.365891 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: exception: Flavor 84 could not be found. Jul 28 18:05:42.365891 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: action_args: {'id': '84'} Jul 28 18:05:42.365891 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: {{(pid=103924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:05:42.365891 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:05:42.368057 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 18:05:42.368057 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 18:05:42.368057 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 18:05:42.368057 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 18:05:42.368057 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 18:05:42.368057 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 18:05:42.368057 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 18:05:42.368057 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 18:05:42.368057 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 18:05:42.368057 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:05:42.368057 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 18:05:42.368057 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 18:05:42.368057 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 28 18:05:42.368057 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi Jul 28 18:05:42.368057 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:05:42.368057 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi Jul 28 18:05:42.368057 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:05:42.368057 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:05:42.368057 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:05:42.370115 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:05:42.370115 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:05:42.370115 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:05:42.370115 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:05:42.370115 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 18:05:42.370115 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:05:42.370115 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 28 18:05:42.370115 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi Jul 28 18:05:42.370115 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:05:42.370115 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi Jul 28 18:05:42.370115 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:05:42.370115 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:05:42.370115 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:05:42.370115 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:05:42.370115 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:05:42.370115 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 28 18:05:42.370115 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi Jul 28 18:05:42.370115 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi [None req-0bbb0a98-13d5-49d1-ba1c-31e08af623ba admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:05:42.372273 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: INFO nova.api.openstack.requestlog [None req-0bbb0a98-13d5-49d1-ba1c-31e08af623ba admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.411064 Jul 28 18:05:42.372273 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: [pid: 103924|app: 0|req: 23/44] 10.222.0.86 () {60 vars in 1190 bytes} [Thu Jul 28 18:05:41 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 412 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 28 18:05:42.376422 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi [None req-dec08091-9265-4d1d-9d5f-649f3bc4c423 admin admin] Calling method '>' {{(pid=103925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:42.391181 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: INFO nova.api.openstack.requestlog [None req-dec08091-9265-4d1d-9d5f-649f3bc4c423 admin admin] 10.222.0.86 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018371 Jul 28 18:05:42.391697 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: [pid: 103925|app: 0|req: 22/45] 10.222.0.86 () {60 vars in 1210 bytes} [Thu Jul 28 18:05:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:05:42.400828 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi [None req-672fdd15-60b8-47ba-ab04-f921c8e73831 admin admin] Calling method '>' {{(pid=103924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:42.416196 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: INFO nova.api.openstack.requestlog [None req-672fdd15-60b8-47ba-ab04-f921c8e73831 admin admin] 10.222.0.86 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018830 Jul 28 18:05:42.416754 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: [pid: 103924|app: 0|req: 24/46] 10.222.0.86 () {60 vars in 1210 bytes} [Thu Jul 28 18:05:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:05:42.426134 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi [None req-8103b256-5ad4-4251-959b-603d090f326a admin admin] Calling method '>' {{(pid=103925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:42.432370 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: INFO nova.api.openstack.wsgi [None req-8103b256-5ad4-4251-959b-603d090f326a admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 28 18:05:42.433889 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi [None req-8103b256-5ad4-4251-959b-603d090f326a admin admin] Request method failure captured: Jul 28 18:05:42.433889 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 28 18:05:42.433889 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: Accept: application/json Jul 28 18:05:42.433889 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: Accept-Encoding: gzip, deflate Jul 28 18:05:42.433889 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: Connection: keep-alive Jul 28 18:05:42.433889 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: Content-Length: 0 Jul 28 18:05:42.433889 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: Host: 10.222.0.86 Jul 28 18:05:42.433889 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: Openstack-Api-Version: compute 2.90 Jul 28 18:05:42.433889 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: Openstack-System-Scope: None Jul 28 18:05:42.433889 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: User-Agent: python-novaclient Jul 28 18:05:42.433889 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: X-Auth-Token: gAAAAABi4s_1i4tSMmuwI7jSRtqdJI6vnmjAnHFeidmUGNm7zQqsEEuoVCOn4_9bBXfuwCqnSVpN8XXL7BUTGpVJEnWl7pzX5KazgyZQHPpeH-iXDjh__eJZ5aUa3cxLUcCMHKWLC7I75-6aNiDoCjnqfgQBJniE8jRDpW9lTmcxH4XK6_1Vc68 Jul 28 18:05:42.433889 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: X-Domain-Id: None Jul 28 18:05:42.433889 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: X-Domain-Name: None Jul 28 18:05:42.433889 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: X-Identity-Status: Confirmed Jul 28 18:05:42.433889 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: X-Is-Admin-Project: True Jul 28 18:05:42.433889 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 18:05:42.433889 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: X-Project-Domain-Id: default Jul 28 18:05:42.433889 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: X-Project-Domain-Name: Default Jul 28 18:05:42.433889 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: X-Project-Id: e2f95f7ebd0046e996236ac2938731ae Jul 28 18:05:42.433889 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: X-Project-Name: admin Jul 28 18:05:42.433889 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: X-Role: member,admin,reader Jul 28 18:05:42.433889 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: X-Roles: member,admin,reader Jul 28 18:05:42.435481 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_e2f95f7ebd0046e996236ac2938731ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/e2f95f7ebd0046e996236ac2938731ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/e2f95f7ebd0046e996236ac2938731ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/e2f95f7ebd0046e996236ac2938731ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}] Jul 28 18:05:42.435481 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: X-Tenant: admin Jul 28 18:05:42.435481 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: X-Tenant-Id: e2f95f7ebd0046e996236ac2938731ae Jul 28 18:05:42.435481 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: X-Tenant-Name: admin Jul 28 18:05:42.435481 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: X-User: admin Jul 28 18:05:42.435481 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: X-User-Domain-Id: default Jul 28 18:05:42.435481 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: X-User-Domain-Name: Default Jul 28 18:05:42.435481 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: X-User-Id: 1dff148688b84b08aaa5c8689269444f Jul 28 18:05:42.435481 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: X-User-Name: admin Jul 28 18:05:42.435481 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: method: > Jul 28 18:05:42.435481 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: exception: Flavor 84 could not be found. Jul 28 18:05:42.435481 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: action_args: {'id': '84'} Jul 28 18:05:42.435481 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: {{(pid=103925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:05:42.435481 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:05:42.436575 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 18:05:42.436575 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 18:05:42.436575 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 18:05:42.436575 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 18:05:42.436575 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 18:05:42.436575 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 18:05:42.436575 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 18:05:42.436575 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 18:05:42.436575 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 18:05:42.436575 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:05:42.436575 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 18:05:42.436575 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 18:05:42.436575 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 28 18:05:42.436575 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi Jul 28 18:05:42.436575 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:05:42.436575 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi Jul 28 18:05:42.436575 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:05:42.436575 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:05:42.436575 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:05:42.437892 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:05:42.437892 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:05:42.437892 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:05:42.437892 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:05:42.437892 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 18:05:42.437892 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:05:42.437892 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 28 18:05:42.437892 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi Jul 28 18:05:42.437892 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:05:42.437892 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi Jul 28 18:05:42.437892 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:05:42.437892 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:05:42.437892 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:05:42.437892 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:05:42.437892 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:05:42.437892 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 28 18:05:42.437892 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi Jul 28 18:05:42.437892 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi [None req-8103b256-5ad4-4251-959b-603d090f326a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103925) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:05:42.439138 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: INFO nova.api.openstack.requestlog [None req-8103b256-5ad4-4251-959b-603d090f326a admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012715 Jul 28 18:05:42.439138 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: [pid: 103925|app: 0|req: 23/47] 10.222.0.86 () {60 vars in 1190 bytes} [Thu Jul 28 18:05:42 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 18:05:43.409227 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi [None req-672fdd15-60b8-47ba-ab04-f921c8e73831 admin admin] Calling method '>' {{(pid=103924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:43.410238 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: INFO nova.api.openstack.requestlog [None req-672fdd15-60b8-47ba-ab04-f921c8e73831 admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jul 28 18:05:43.410632 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: [pid: 103924|app: 0|req: 25/48] 10.222.0.86 () {56 vars in 1074 bytes} [Thu Jul 28 18:05:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:05:43.933900 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi [None req-e2ea19c4-e678-40a0-85e1-391cca0c9b43 admin admin] Calling method '>' {{(pid=103925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:43.939699 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: INFO nova.api.openstack.wsgi [None req-e2ea19c4-e678-40a0-85e1-391cca0c9b43 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 28 18:05:43.941215 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi [None req-e2ea19c4-e678-40a0-85e1-391cca0c9b43 admin admin] Request method failure captured: Jul 28 18:05:43.941215 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 28 18:05:43.941215 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: Accept: application/json Jul 28 18:05:43.941215 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: Accept-Encoding: gzip, deflate Jul 28 18:05:43.941215 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: Connection: keep-alive Jul 28 18:05:43.941215 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: Content-Length: 0 Jul 28 18:05:43.941215 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: Host: 10.222.0.86 Jul 28 18:05:43.941215 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: Openstack-Api-Version: compute 2.90 Jul 28 18:05:43.941215 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: Openstack-System-Scope: None Jul 28 18:05:43.941215 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: User-Agent: python-novaclient Jul 28 18:05:43.941215 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: X-Auth-Token: gAAAAABi4s_3Cuiv7j6ZQWsYvRAaoaLekVhD-DYmmdgo3pCjxSDogSfdrrvFNax7Ov6uT7vSJBI0ow3ZfzDTNuEh0TriNPThnPifQmenicZ1CraCWZ2-p0RDP3Ei_gYG0UdmTeImGqyaZGx2erMjjREnWO4orkYTPfuSL4vu4kIR0PzmjzBuqtk Jul 28 18:05:43.941215 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: X-Domain-Id: None Jul 28 18:05:43.941215 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: X-Domain-Name: None Jul 28 18:05:43.941215 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: X-Identity-Status: Confirmed Jul 28 18:05:43.941215 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: X-Is-Admin-Project: True Jul 28 18:05:43.941215 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 18:05:43.941215 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: X-Project-Domain-Id: default Jul 28 18:05:43.941215 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: X-Project-Domain-Name: Default Jul 28 18:05:43.941215 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: X-Project-Id: e2f95f7ebd0046e996236ac2938731ae Jul 28 18:05:43.941215 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: X-Project-Name: admin Jul 28 18:05:43.941215 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: X-Role: member,admin,reader Jul 28 18:05:43.941215 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: X-Roles: member,admin,reader Jul 28 18:05:43.942546 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_e2f95f7ebd0046e996236ac2938731ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/e2f95f7ebd0046e996236ac2938731ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/e2f95f7ebd0046e996236ac2938731ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/e2f95f7ebd0046e996236ac2938731ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}] Jul 28 18:05:43.942546 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: X-Tenant: admin Jul 28 18:05:43.942546 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: X-Tenant-Id: e2f95f7ebd0046e996236ac2938731ae Jul 28 18:05:43.942546 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: X-Tenant-Name: admin Jul 28 18:05:43.942546 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: X-User: admin Jul 28 18:05:43.942546 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: X-User-Domain-Id: default Jul 28 18:05:43.942546 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: X-User-Domain-Name: Default Jul 28 18:05:43.942546 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: X-User-Id: 1dff148688b84b08aaa5c8689269444f Jul 28 18:05:43.942546 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: X-User-Name: admin Jul 28 18:05:43.942546 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: method: > Jul 28 18:05:43.942546 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: exception: Flavor 451 could not be found. Jul 28 18:05:43.942546 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: action_args: {'id': '451'} Jul 28 18:05:43.942546 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: {{(pid=103925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:05:43.942546 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:05:43.943353 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 18:05:43.943353 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 18:05:43.943353 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 18:05:43.943353 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 18:05:43.943353 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 18:05:43.943353 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 18:05:43.943353 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 18:05:43.943353 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 18:05:43.943353 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 18:05:43.943353 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:05:43.943353 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 18:05:43.943353 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 18:05:43.943353 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 28 18:05:43.943353 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi Jul 28 18:05:43.943353 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:05:43.943353 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi Jul 28 18:05:43.943353 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:05:43.943353 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:05:43.943353 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:05:43.944639 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:05:43.944639 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:05:43.944639 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:05:43.944639 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:05:43.944639 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 18:05:43.944639 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:05:43.944639 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 28 18:05:43.944639 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi Jul 28 18:05:43.944639 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:05:43.944639 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi Jul 28 18:05:43.944639 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:05:43.944639 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:05:43.944639 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:05:43.944639 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:05:43.944639 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:05:43.944639 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 28 18:05:43.944639 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: ERROR nova.api.openstack.wsgi Jul 28 18:05:43.944639 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi [None req-e2ea19c4-e678-40a0-85e1-391cca0c9b43 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103925) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:05:43.945922 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: INFO nova.api.openstack.requestlog [None req-e2ea19c4-e678-40a0-85e1-391cca0c9b43 admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.389651 Jul 28 18:05:43.945922 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: [pid: 103925|app: 0|req: 24/49] 10.222.0.86 () {60 vars in 1193 bytes} [Thu Jul 28 18:05:43 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 18:05:43.952256 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi [None req-5535d624-7b67-4857-a677-dce95a8944a0 admin admin] Calling method '>' {{(pid=103924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:43.969080 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: INFO nova.api.openstack.requestlog [None req-5535d624-7b67-4857-a677-dce95a8944a0 admin admin] 10.222.0.86 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020367 Jul 28 18:05:43.969630 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: [pid: 103924|app: 0|req: 26/50] 10.222.0.86 () {60 vars in 1210 bytes} [Thu Jul 28 18:05:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:05:43.979816 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi [None req-bb4b6a2e-be40-47f8-be9c-a425264a5fda admin admin] Calling method '>' {{(pid=103925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:43.995519 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: INFO nova.api.openstack.requestlog [None req-bb4b6a2e-be40-47f8-be9c-a425264a5fda admin admin] 10.222.0.86 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019839 Jul 28 18:05:43.996052 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: [pid: 103925|app: 0|req: 25/51] 10.222.0.86 () {60 vars in 1210 bytes} [Thu Jul 28 18:05:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:05:44.005193 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi [None req-26278646-cbce-4e51-8383-24f22bed7c97 admin admin] Calling method '>' {{(pid=103924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:44.010461 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: INFO nova.api.openstack.wsgi [None req-26278646-cbce-4e51-8383-24f22bed7c97 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 28 18:05:44.011946 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi [None req-26278646-cbce-4e51-8383-24f22bed7c97 admin admin] Request method failure captured: Jul 28 18:05:44.011946 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 28 18:05:44.011946 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: Accept: application/json Jul 28 18:05:44.011946 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: Accept-Encoding: gzip, deflate Jul 28 18:05:44.011946 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: Connection: keep-alive Jul 28 18:05:44.011946 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: Content-Length: 0 Jul 28 18:05:44.011946 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: Host: 10.222.0.86 Jul 28 18:05:44.011946 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: Openstack-Api-Version: compute 2.90 Jul 28 18:05:44.011946 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: Openstack-System-Scope: None Jul 28 18:05:44.011946 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: User-Agent: python-novaclient Jul 28 18:05:44.011946 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: X-Auth-Token: gAAAAABi4s_3Cuiv7j6ZQWsYvRAaoaLekVhD-DYmmdgo3pCjxSDogSfdrrvFNax7Ov6uT7vSJBI0ow3ZfzDTNuEh0TriNPThnPifQmenicZ1CraCWZ2-p0RDP3Ei_gYG0UdmTeImGqyaZGx2erMjjREnWO4orkYTPfuSL4vu4kIR0PzmjzBuqtk Jul 28 18:05:44.011946 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: X-Domain-Id: None Jul 28 18:05:44.011946 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: X-Domain-Name: None Jul 28 18:05:44.011946 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: X-Identity-Status: Confirmed Jul 28 18:05:44.011946 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: X-Is-Admin-Project: True Jul 28 18:05:44.011946 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 18:05:44.011946 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: X-Project-Domain-Id: default Jul 28 18:05:44.011946 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: X-Project-Domain-Name: Default Jul 28 18:05:44.011946 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: X-Project-Id: e2f95f7ebd0046e996236ac2938731ae Jul 28 18:05:44.011946 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: X-Project-Name: admin Jul 28 18:05:44.011946 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: X-Role: member,admin,reader Jul 28 18:05:44.011946 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: X-Roles: member,admin,reader Jul 28 18:05:44.013394 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_e2f95f7ebd0046e996236ac2938731ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/e2f95f7ebd0046e996236ac2938731ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/e2f95f7ebd0046e996236ac2938731ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/e2f95f7ebd0046e996236ac2938731ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}] Jul 28 18:05:44.013394 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: X-Tenant: admin Jul 28 18:05:44.013394 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: X-Tenant-Id: e2f95f7ebd0046e996236ac2938731ae Jul 28 18:05:44.013394 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: X-Tenant-Name: admin Jul 28 18:05:44.013394 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: X-User: admin Jul 28 18:05:44.013394 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: X-User-Domain-Id: default Jul 28 18:05:44.013394 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: X-User-Domain-Name: Default Jul 28 18:05:44.013394 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: X-User-Id: 1dff148688b84b08aaa5c8689269444f Jul 28 18:05:44.013394 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: X-User-Name: admin Jul 28 18:05:44.013394 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: method: > Jul 28 18:05:44.013394 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: exception: Flavor 451 could not be found. Jul 28 18:05:44.013394 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: action_args: {'id': '451'} Jul 28 18:05:44.013394 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: {{(pid=103924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:05:44.013394 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:05:44.014394 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 18:05:44.014394 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 18:05:44.014394 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 18:05:44.014394 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 18:05:44.014394 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 18:05:44.014394 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 18:05:44.014394 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 18:05:44.014394 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 18:05:44.014394 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 18:05:44.014394 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:05:44.014394 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 18:05:44.014394 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 18:05:44.014394 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 28 18:05:44.014394 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi Jul 28 18:05:44.014394 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:05:44.014394 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi Jul 28 18:05:44.014394 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:05:44.014394 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:05:44.014394 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:05:44.015773 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:05:44.015773 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:05:44.015773 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:05:44.015773 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:05:44.015773 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 18:05:44.015773 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:05:44.015773 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 28 18:05:44.015773 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi Jul 28 18:05:44.015773 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:05:44.015773 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi Jul 28 18:05:44.015773 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:05:44.015773 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:05:44.015773 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:05:44.015773 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:05:44.015773 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:05:44.015773 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 28 18:05:44.015773 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: ERROR nova.api.openstack.wsgi Jul 28 18:05:44.015773 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi [None req-26278646-cbce-4e51-8383-24f22bed7c97 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:05:44.017106 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: INFO nova.api.openstack.requestlog [None req-26278646-cbce-4e51-8383-24f22bed7c97 admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011600 Jul 28 18:05:44.017106 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: [pid: 103924|app: 0|req: 27/52] 10.222.0.86 () {60 vars in 1193 bytes} [Thu Jul 28 18:05:44 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 18:05:44.987778 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi [None req-bb4b6a2e-be40-47f8-be9c-a425264a5fda admin admin] Calling method '>' {{(pid=103925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:44.988782 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: INFO nova.api.openstack.requestlog [None req-bb4b6a2e-be40-47f8-be9c-a425264a5fda admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Jul 28 18:05:44.989211 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: [pid: 103925|app: 0|req: 26/53] 10.222.0.86 () {56 vars in 1074 bytes} [Thu Jul 28 18:05:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:05:45.519190 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi [None req-c342f9e5-e580-44e5-a522-5110f1ea9811 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:05:45.604272 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: INFO nova.api.openstack.requestlog [None req-c342f9e5-e580-44e5-a522-5110f1ea9811 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.478063 Jul 28 18:05:45.604826 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: [pid: 103924|app: 0|req: 28/54] 10.222.0.86 () {64 vars in 1235 bytes} [Thu Jul 28 18:05:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 18:05:46.579428 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi [None req-bb4b6a2e-be40-47f8-be9c-a425264a5fda admin admin] Calling method '>' {{(pid=103925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:46.580438 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: INFO nova.api.openstack.requestlog [None req-bb4b6a2e-be40-47f8-be9c-a425264a5fda admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001566 Jul 28 18:05:46.580835 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: [pid: 103925|app: 0|req: 27/55] 10.222.0.86 () {56 vars in 1074 bytes} [Thu Jul 28 18:05:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:05:47.100023 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi [None req-a954ff6a-f1db-4c0e-b430-a9979e4b25f0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:05:47.196269 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: INFO nova.api.openstack.requestlog [None req-a954ff6a-f1db-4c0e-b430-a9979e4b25f0 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.477928 Jul 28 18:05:47.196828 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: [pid: 103924|app: 0|req: 29/56] 10.222.0.86 () {64 vars in 1235 bytes} [Thu Jul 28 18:05:46 2022] POST /compute/v2.1/flavors => generated 405 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 18:05:48.177344 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi [None req-bb4b6a2e-be40-47f8-be9c-a425264a5fda admin admin] Calling method '>' {{(pid=103925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:48.178358 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: INFO nova.api.openstack.requestlog [None req-bb4b6a2e-be40-47f8-be9c-a425264a5fda admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jul 28 18:05:48.178763 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: [pid: 103925|app: 0|req: 28/57] 10.222.0.86 () {56 vars in 1074 bytes} [Thu Jul 28 18:05:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:05:48.833486 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi [None req-37b7f224-c35b-41b0-9abb-f3b138c29736 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:05:48.918822 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: INFO nova.api.openstack.requestlog [None req-37b7f224-c35b-41b0-9abb-f3b138c29736 admin admin] 10.222.0.86 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.600656 Jul 28 18:05:48.919429 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: [pid: 103924|app: 0|req: 30/58] 10.222.0.86 () {64 vars in 1235 bytes} [Thu Jul 28 18:05:48 2022] POST /compute/v2.1/flavors => generated 407 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 18:05:49.899333 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi [None req-bb4b6a2e-be40-47f8-be9c-a425264a5fda admin admin] Calling method '>' {{(pid=103925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:49.900335 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: INFO nova.api.openstack.requestlog [None req-bb4b6a2e-be40-47f8-be9c-a425264a5fda admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Jul 28 18:05:49.900735 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: [pid: 103925|app: 0|req: 29/59] 10.222.0.86 () {56 vars in 1074 bytes} [Thu Jul 28 18:05:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:05:50.442163 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi [None req-83cc8040-805e-483c-9647-3277d1b5344f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:05:50.546572 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: INFO nova.api.openstack.requestlog [None req-83cc8040-805e-483c-9647-3277d1b5344f admin admin] 10.222.0.86 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.508404 Jul 28 18:05:50.547139 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: [pid: 103924|app: 0|req: 31/60] 10.222.0.86 () {64 vars in 1235 bytes} [Thu Jul 28 18:05:50 2022] POST /compute/v2.1/flavors => generated 409 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 18:05:51.689062 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi [None req-bb4b6a2e-be40-47f8-be9c-a425264a5fda admin admin] Calling method '>' {{(pid=103925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:51.690108 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: INFO nova.api.openstack.requestlog [None req-bb4b6a2e-be40-47f8-be9c-a425264a5fda admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001588 Jul 28 18:05:51.690500 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: [pid: 103925|app: 0|req: 30/61] 10.222.0.86 () {56 vars in 1074 bytes} [Thu Jul 28 18:05:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:05:52.214641 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi [None req-be76455e-6eb2-4136-870b-75acc9de8894 admin admin] Calling method '>' {{(pid=103924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:52.235329 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: INFO nova.api.openstack.requestlog [None req-be76455e-6eb2-4136-870b-75acc9de8894 admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.404685 Jul 28 18:05:52.235789 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: [pid: 103924|app: 0|req: 32/62] 10.222.0.86 () {60 vars in 1202 bytes} [Thu Jul 28 18:05:51 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:06:44.359823 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi [None req-bb4b6a2e-be40-47f8-be9c-a425264a5fda admin admin] Calling method '>' {{(pid=103925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:44.360840 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: INFO nova.api.openstack.requestlog [None req-bb4b6a2e-be40-47f8-be9c-a425264a5fda admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Jul 28 18:06:44.361305 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: [pid: 103925|app: 0|req: 31/63] 10.222.0.86 () {54 vars in 930 bytes} [Thu Jul 28 18:06:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:06:44.372161 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG dbcounter [-] [103924] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:44.773185 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi [None req-3b626e5b-0a83-4835-af99-ec812cf26ea8 admin admin] Calling method '>' {{(pid=103924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:44.793495 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: INFO nova.api.openstack.requestlog [None req-3b626e5b-0a83-4835-af99-ec812cf26ea8 admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.425785 Jul 28 18:06:44.794042 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: [pid: 103924|app: 0|req: 33/64] 10.222.0.86 () {60 vars in 1291 bytes} [Thu Jul 28 18:06:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:06:44.816028 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG dbcounter [-] [103925] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=103925) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:44.820271 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi [None req-e260d9c5-9ef2-4ffb-badb-0c727b84c6fe admin admin] Calling method '>' {{(pid=103925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:44.827889 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: INFO nova.api.openstack.requestlog [None req-e260d9c5-9ef2-4ffb-badb-0c727b84c6fe admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013662 Jul 28 18:06:44.828537 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: [pid: 103925|app: 0|req: 32/65] 10.222.0.86 () {60 vars in 1282 bytes} [Thu Jul 28 18:06:44 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:44.840995 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi [None req-7514f3e6-400b-4539-b013-0cd03a94d1b0 admin admin] Calling method '>' {{(pid=103924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:44.848700 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: INFO nova.api.openstack.requestlog [None req-7514f3e6-400b-4539-b013-0cd03a94d1b0 admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011435 Jul 28 18:06:44.849250 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: [pid: 103924|app: 0|req: 34/66] 10.222.0.86 () {60 vars in 1285 bytes} [Thu Jul 28 18:06:44 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:44.860537 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi [None req-a7c25fae-0b5f-42d3-a642-94be0f326bab admin admin] Calling method '>' {{(pid=103925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:44.868456 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: INFO nova.api.openstack.requestlog [None req-a7c25fae-0b5f-42d3-a642-94be0f326bab admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011715 Jul 28 18:06:44.868990 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: [pid: 103925|app: 0|req: 33/67] 10.222.0.86 () {60 vars in 1285 bytes} [Thu Jul 28 18:06:44 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:06:44.880861 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi [None req-8597e3ce-7225-4949-8a64-d835e1e8e063 admin admin] Calling method '>' {{(pid=103924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:44.888511 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: INFO nova.api.openstack.requestlog [None req-8597e3ce-7225-4949-8a64-d835e1e8e063 admin admin] 10.222.0.86 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011710 Jul 28 18:06:44.889136 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: [pid: 103924|app: 0|req: 35/68] 10.222.0.86 () {60 vars in 1282 bytes} [Thu Jul 28 18:06:44 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:10:21.119342 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi [None req-a7c25fae-0b5f-42d3-a642-94be0f326bab admin admin] Calling method '>' {{(pid=103925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:10:21.120384 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: INFO nova.api.openstack.requestlog [None req-a7c25fae-0b5f-42d3-a642-94be0f326bab admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Jul 28 18:10:21.120800 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: [pid: 103925|app: 0|req: 34/69] 10.222.0.86 () {56 vars in 1074 bytes} [Thu Jul 28 18:10:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:10:21.276270 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG dbcounter [-] [103924] Writing DB stats nova_api:SELECT=6 {{(pid=103924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:21.435858 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi [None req-cebebfe4-6834-4e72-a100-672808099a17 admin admin] Calling method '>' {{(pid=103924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:10:21.438210 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 18:10:21.438210 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: warnings.warn(msg) Jul 28 18:10:21.439408 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG oslo_concurrency.lockutils [None req-cebebfe4-6834-4e72-a100-672808099a17 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:21.439841 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG oslo_concurrency.lockutils [None req-cebebfe4-6834-4e72-a100-672808099a17 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:21.440618 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG oslo_concurrency.lockutils [None req-cebebfe4-6834-4e72-a100-672808099a17 admin admin] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:21.441584 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG oslo_concurrency.lockutils [None req-cebebfe4-6834-4e72-a100-672808099a17 admin admin] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:21.475158 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: INFO nova.api.openstack.requestlog [None req-cebebfe4-6834-4e72-a100-672808099a17 admin admin] 10.222.0.86 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.200424 Jul 28 18:10:21.475713 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: [pid: 103924|app: 0|req: 36/70] 10.222.0.86 () {60 vars in 1193 bytes} [Thu Jul 28 18:10:21 2022] GET /compute/v2.1/os-services => generated 791 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 18:10:22.298402 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi [None req-a7c25fae-0b5f-42d3-a642-94be0f326bab admin admin] Calling method '>' {{(pid=103925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:10:22.299405 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: INFO nova.api.openstack.requestlog [None req-a7c25fae-0b5f-42d3-a642-94be0f326bab admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 Jul 28 18:10:22.299799 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: [pid: 103925|app: 0|req: 35/71] 10.222.0.86 () {56 vars in 1074 bytes} [Thu Jul 28 18:10:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:10:22.494150 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi [None req-7185eab2-3125-41f2-9890-76e9e64ce134 admin admin] Calling method '>' {{(pid=103924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:10:22.496522 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 18:10:22.496522 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: warnings.warn(msg) Jul 28 18:10:22.497800 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG oslo_concurrency.lockutils [None req-7185eab2-3125-41f2-9890-76e9e64ce134 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:22.498239 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG oslo_concurrency.lockutils [None req-7185eab2-3125-41f2-9890-76e9e64ce134 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:22.499057 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG oslo_concurrency.lockutils [None req-7185eab2-3125-41f2-9890-76e9e64ce134 admin admin] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:22.499484 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG oslo_concurrency.lockutils [None req-7185eab2-3125-41f2-9890-76e9e64ce134 admin admin] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:22.519388 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: INFO nova.api.openstack.requestlog [None req-7185eab2-3125-41f2-9890-76e9e64ce134 admin admin] 10.222.0.86 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.077111 Jul 28 18:10:22.519876 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: [pid: 103924|app: 0|req: 37/72] 10.222.0.86 () {60 vars in 1193 bytes} [Thu Jul 28 18:10:22 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 18:10:33.782878 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi [None req-a7c25fae-0b5f-42d3-a642-94be0f326bab admin admin] Calling method '>' {{(pid=103925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:10:33.783944 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: INFO nova.api.openstack.requestlog [None req-a7c25fae-0b5f-42d3-a642-94be0f326bab admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Jul 28 18:10:33.785639 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: [pid: 103925|app: 0|req: 36/73] 10.222.0.86 () {56 vars in 1074 bytes} [Thu Jul 28 18:10:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:10:33.929758 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG dbcounter [-] [103924] Writing DB stats nova_cell0:SELECT=4 {{(pid=103924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:33.930418 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG dbcounter [-] [103924] Writing DB stats nova_cell1:SELECT=4 {{(pid=103924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:33.931091 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG dbcounter [-] [103924] Writing DB stats nova_api:SELECT=8 {{(pid=103924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:33.979292 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi [None req-74a3b625-5620-4fc1-a562-9ca20a61e25c admin admin] Calling method '>' {{(pid=103924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:10:33.981684 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 18:10:33.981684 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: warnings.warn(msg) Jul 28 18:10:33.983040 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG oslo_concurrency.lockutils [None req-74a3b625-5620-4fc1-a562-9ca20a61e25c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:33.983479 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG oslo_concurrency.lockutils [None req-74a3b625-5620-4fc1-a562-9ca20a61e25c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:33.984260 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG oslo_concurrency.lockutils [None req-74a3b625-5620-4fc1-a562-9ca20a61e25c admin admin] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:33.984683 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG oslo_concurrency.lockutils [None req-74a3b625-5620-4fc1-a562-9ca20a61e25c admin admin] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:34.010115 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: INFO nova.api.openstack.requestlog [None req-74a3b625-5620-4fc1-a562-9ca20a61e25c admin admin] 10.222.0.86 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.085596 Jul 28 18:10:34.010674 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: [pid: 103924|app: 0|req: 38/74] 10.222.0.86 () {60 vars in 1193 bytes} [Thu Jul 28 18:10:33 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:10:34.844641 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: DEBUG nova.api.openstack.wsgi [None req-a7c25fae-0b5f-42d3-a642-94be0f326bab admin admin] Calling method '>' {{(pid=103925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:10:34.845698 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: INFO nova.api.openstack.requestlog [None req-a7c25fae-0b5f-42d3-a642-94be0f326bab admin admin] 10.222.0.86 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Jul 28 18:10:34.846097 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: [pid: 103925|app: 0|req: 37/75] 10.222.0.86 () {56 vars in 1074 bytes} [Thu Jul 28 18:10:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:10:35.036877 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG nova.api.openstack.wsgi [None req-8f58989f-079e-44ee-aaf3-48e0bca2947e admin admin] Calling method '>' {{(pid=103924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:10:35.039261 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 18:10:35.039261 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: warnings.warn(msg) Jul 28 18:10:35.040460 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG oslo_concurrency.lockutils [None req-8f58989f-079e-44ee-aaf3-48e0bca2947e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:35.040905 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG oslo_concurrency.lockutils [None req-8f58989f-079e-44ee-aaf3-48e0bca2947e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:35.041720 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG oslo_concurrency.lockutils [None req-8f58989f-079e-44ee-aaf3-48e0bca2947e admin admin] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:35.042150 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: DEBUG oslo_concurrency.lockutils [None req-8f58989f-079e-44ee-aaf3-48e0bca2947e admin admin] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:35.063924 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: INFO nova.api.openstack.requestlog [None req-8f58989f-079e-44ee-aaf3-48e0bca2947e admin admin] 10.222.0.86 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.079990 Jul 28 18:10:35.064410 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: [pid: 103924|app: 0|req: 39/76] 10.222.0.86 () {60 vars in 1193 bytes} [Thu Jul 28 18:10:34 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:11:33.160446 dv-cinder-846173-4-iscsi devstack@n-api.service[103923]: Thu Jul 28 18:11:33 2022 - graceful shutdown triggered... Jul 28 18:11:33.161011 dv-cinder-846173-4-iscsi devstack@n-api.service[103924]: Gracefully killing worker 1 (pid: 103924)... Jul 28 18:11:33.160508 dv-cinder-846173-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 28 18:11:33.161811 dv-cinder-846173-4-iscsi devstack@n-api.service[103925]: Gracefully killing worker 2 (pid: 103925)... Jul 28 18:11:34.161585 dv-cinder-846173-4-iscsi devstack@n-api.service[103923]: worker 1 buried after 1 seconds Jul 28 18:11:34.162086 dv-cinder-846173-4-iscsi devstack@n-api.service[103923]: worker 2 buried after 1 seconds Jul 28 18:11:34.162086 dv-cinder-846173-4-iscsi devstack@n-api.service[103923]: goodbye to uWSGI. Jul 28 18:11:34.163224 dv-cinder-846173-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 28 18:11:34.163773 dv-cinder-846173-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 28 18:11:34.166596 dv-cinder-846173-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 28 18:11:34.176988 dv-cinder-846173-4-iscsi devstack@n-api.service[118436]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 28 18:11:34.179572 dv-cinder-846173-4-iscsi devstack@n-api.service[118436]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 28 18:11:34 2022] *** Jul 28 18:11:34.179732 dv-cinder-846173-4-iscsi devstack@n-api.service[118436]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 28 18:11:34.179878 dv-cinder-846173-4-iscsi devstack@n-api.service[118436]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 28 18:11:34.180001 dv-cinder-846173-4-iscsi devstack@n-api.service[118436]: nodename: dv-cinder-846173-4-iscsi Jul 28 18:11:34.180113 dv-cinder-846173-4-iscsi devstack@n-api.service[118436]: machine: x86_64 Jul 28 18:11:34.180232 dv-cinder-846173-4-iscsi devstack@n-api.service[118436]: clock source: unix Jul 28 18:11:34.180348 dv-cinder-846173-4-iscsi devstack@n-api.service[118436]: pcre jit disabled Jul 28 18:11:34.180464 dv-cinder-846173-4-iscsi devstack@n-api.service[118436]: detected number of CPU cores: 4 Jul 28 18:11:34.180573 dv-cinder-846173-4-iscsi devstack@n-api.service[118436]: current working directory: / Jul 28 18:11:34.180680 dv-cinder-846173-4-iscsi devstack@n-api.service[118436]: detected binary path: /usr/bin/uwsgi-core Jul 28 18:11:34.180794 dv-cinder-846173-4-iscsi devstack@n-api.service[118436]: your processes number limit is 47680 Jul 28 18:11:34.180915 dv-cinder-846173-4-iscsi devstack@n-api.service[118436]: your memory page size is 4096 bytes Jul 28 18:11:34.181056 dv-cinder-846173-4-iscsi devstack@n-api.service[118436]: detected max file descriptor number: 2048 Jul 28 18:11:34.181182 dv-cinder-846173-4-iscsi devstack@n-api.service[118436]: lock engine: pthread robust mutexes Jul 28 18:11:34.181461 dv-cinder-846173-4-iscsi devstack@n-api.service[118436]: thunder lock: enabled Jul 28 18:11:34.181765 dv-cinder-846173-4-iscsi devstack@n-api.service[118436]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 28 18:11:34.181971 dv-cinder-846173-4-iscsi devstack@n-api.service[118436]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 28 18:11:34.221614 dv-cinder-846173-4-iscsi devstack@n-api.service[118436]: Python main interpreter initialized at 0x560909e9b9c0 Jul 28 18:11:34.221614 dv-cinder-846173-4-iscsi devstack@n-api.service[118436]: python threads support enabled Jul 28 18:11:34.221614 dv-cinder-846173-4-iscsi devstack@n-api.service[118436]: your server socket listen backlog is limited to 100 connections Jul 28 18:11:34.221614 dv-cinder-846173-4-iscsi devstack@n-api.service[118436]: your mercy for graceful operations on workers is 90 seconds Jul 28 18:11:34.222421 dv-cinder-846173-4-iscsi devstack@n-api.service[118436]: mapped 403077 bytes (393 KB) for 2 cores Jul 28 18:11:34.222421 dv-cinder-846173-4-iscsi devstack@n-api.service[118436]: *** Operational MODE: preforking *** Jul 28 18:11:34.222611 dv-cinder-846173-4-iscsi devstack@n-api.service[118436]: *** uWSGI is running in multiple interpreter mode *** Jul 28 18:11:34.222611 dv-cinder-846173-4-iscsi devstack@n-api.service[118436]: spawned uWSGI master process (pid: 118436) Jul 28 18:11:34.222790 dv-cinder-846173-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 28 18:11:34.223428 dv-cinder-846173-4-iscsi devstack@n-api.service[118436]: spawned uWSGI worker 1 (pid: 118453, cores: 1) Jul 28 18:11:34.223706 dv-cinder-846173-4-iscsi devstack@n-api.service[118436]: spawned uWSGI worker 2 (pid: 118454, cores: 1) Jul 28 18:11:34.224018 dv-cinder-846173-4-iscsi devstack@n-api.service[118436]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 28 18:11:34.894369 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 28 18:11:34.920730 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 28 18:11:36.055256 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 18:11:36.055256 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: from cryptography.utils import int_from_bytes Jul 28 18:11:36.055828 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 18:11:36.055828 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: from cryptography.utils import int_from_bytes Jul 28 18:11:36.092193 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 18:11:36.092193 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: from cryptography.utils import int_from_bytes Jul 28 18:11:36.092819 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 18:11:36.092819 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: from cryptography.utils import int_from_bytes Jul 28 18:11:38.509350 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 18:11:38.509988 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 18:11:38.510301 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 18:11:38.510677 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 18:11:38.510942 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 18:11:38.511345 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.511685 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.512180 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.512519 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.512864 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.513214 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.513552 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.513886 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.514229 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.514508 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.514832 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.515166 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846173-4-iscsi {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.515499 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.515997 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.516325 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.516658 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.517541 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.517893 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.518226 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.518735 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.519911 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.519911 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.519911 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.520286 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.520455 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.520777 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.521137 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.521459 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.521799 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.522118 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.522555 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846173-4-iscsi {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.522890 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.523235 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.523540 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.523978 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.524299 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.524622 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.524954 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.525313 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.525634 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.525988 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.526302 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.526633 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.526963 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.527275 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.527596 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.527917 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.528247 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.528562 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.528875 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.529162 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.529483 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.529818 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.530149 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.530484 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.530743 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.531002 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.531330 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.531659 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.531979 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.532297 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.532644 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.532989 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.533289 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.533602 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.533918 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.534235 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.534573 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.534897 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.535232 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.535549 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.535877 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.536299 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.86 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.536562 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.86 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.536865 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.537250 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.537584 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.537900 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.538233 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.538579 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.538886 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.539201 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.539517 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.540139 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.542571 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.542571 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.542571 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.542571 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.543229 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.543434 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.543593 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.543885 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.544293 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.544523 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.544845 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.545192 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.545689 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.546031 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.546340 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.546658 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.546978 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.547298 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.547651 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.547953 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.548320 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.548639 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.549040 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.549306 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.549620 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.549971 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.550296 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.550589 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.550923 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.551242 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.551545 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.551872 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.552370 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.552695 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.556821 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.556821 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.556821 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.556821 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.556821 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.556821 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.556821 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.556821 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.558132 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.558132 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.558132 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.558132 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.558132 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.558132 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.558132 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.559129 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.559129 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.559129 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.559129 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.559668 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.559815 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.560139 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.560486 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.560719 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.561102 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.561436 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.561758 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.562086 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.562425 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.562751 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.563076 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.563401 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.564250 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.564602 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.564927 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.565282 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.565612 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.565942 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.566265 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.566674 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.566924 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.567340 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.567571 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.567922 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.568281 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.568608 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.568944 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.569301 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.569624 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.569946 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.570274 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.570469 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 18:11:38.571096 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.571256 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 18:11:38.571422 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.571663 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 18:11:38.571812 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.571812 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.572097 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 18:11:38.572097 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 18:11:38.572377 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.572377 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.572698 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.572850 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.573065 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.573217 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.573357 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.573510 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.573651 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.573791 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.573938 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.574172 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.574329 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.574478 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.574618 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.574757 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.574896 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.575037 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.575186 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.575186 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.575460 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.575599 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.575746 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.575894 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846173-4-iscsi {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.576062 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.576217 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.576365 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.576365 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.576763 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.577081 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.577241 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.577402 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.577617 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.577776 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.577925 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.577925 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.578214 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.578370 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.578519 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.578680 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.578835 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.578977 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.579125 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.579266 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.579482 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.580139 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.580531 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.580691 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.580852 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.581063 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.581329 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.581953 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.582300 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.582642 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.583051 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.583301 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.583647 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.583981 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.584306 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.584648 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.585005 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.585325 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.585656 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.585984 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.586315 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.586643 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.587033 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.587302 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.587667 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.588000 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.588287 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.588634 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.588953 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.589357 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.589696 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.590075 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.590230 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.590382 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.590622 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.590779 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.590928 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.591080 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.591228 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.591473 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.591622 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.591782 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846173-4-iscsi {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.592017 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.592174 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.592316 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.592456 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.592596 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.592745 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.592895 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.593074 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.593369 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.593564 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.593705 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.593856 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.594004 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.594167 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.594309 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.594457 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.594597 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.594750 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.594892 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.595078 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.595229 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.595379 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.595540 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.595690 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.595830 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.595989 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.596131 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.596290 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.596518 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.596932 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.597256 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.597418 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.597559 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.597726 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.597957 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.598125 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.598359 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.598508 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.598666 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.598666 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.598949 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.599138 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.599281 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.599428 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.599579 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.599733 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.599880 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.600029 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.600192 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.600360 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.600520 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.600679 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.600912 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.601090 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.601235 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.601383 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.601625 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.601780 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.601932 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.601932 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.601932 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.602426 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.602426 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.602748 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.603090 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.603409 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.603735 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.604051 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.604364 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.604675 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.605607 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.605607 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.605914 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.606080 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.606276 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.606617 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.606935 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.607309 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.607574 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.607897 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.608234 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.608580 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.608900 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.609249 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.609405 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.609581 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.609738 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.609928 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.610095 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.610244 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.610390 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.610530 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.610781 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.611024 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.611308 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.611467 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.611609 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.611769 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.612066 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.612345 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.612494 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.612659 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.612822 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.613063 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.613238 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.613392 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.613583 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.613727 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.613895 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.86 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.613895 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.86 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.614307 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.614452 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.614600 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.614600 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.614895 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.615045 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.615199 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.615342 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.615489 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.615637 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.615777 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.615927 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.616068 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.616068 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.616332 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.616481 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.616651 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.616878 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.617137 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.617305 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.617585 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.617761 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.617906 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.618067 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.618306 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.618462 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.618624 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.618861 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.619009 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.619174 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.619317 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.619317 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.619317 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.619317 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.619861 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.620010 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.620160 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.620311 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.620451 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.620599 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.620748 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.620889 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.621152 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.621303 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.621444 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.621583 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.621736 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.621736 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.621736 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.622245 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.622245 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.622617 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.622836 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.623150 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.623486 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.623816 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.624132 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.624448 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.624763 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.632995 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.633250 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.633444 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.633652 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.633811 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.633971 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.634127 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.634127 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.634127 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.634579 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.634733 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.634883 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.635034 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.635034 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.635329 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.635569 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.635799 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.635948 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.635948 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.636231 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.636373 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.636525 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.636673 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.636824 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.637068 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.637270 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.637414 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.637554 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.637728 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.637883 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.638040 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.638040 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.638040 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.638462 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.638627 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.638778 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.638931 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.639093 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.639242 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.639242 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.639518 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.639670 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.639819 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.639960 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.639960 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.639960 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.639960 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:11:38.639960 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.639960 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.639960 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.639960 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.641041 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.641041 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.641041 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.641041 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.641041 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.641041 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.641041 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.641041 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.644788 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.644788 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.644788 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.644788 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.644788 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.644788 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.644788 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.644788 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.645927 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.645927 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.646205 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.646205 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.646205 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.646621 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.646621 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.646621 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.646621 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.646621 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.647458 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.647458 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.647732 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.647913 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.652982 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.652982 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.652982 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.653496 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.653662 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.653876 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.654040 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.654189 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.654339 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.654522 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.654682 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.654835 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.654977 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.654977 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.655261 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.655418 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.655587 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.655739 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.655739 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.656053 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.656195 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.656348 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.656504 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.656658 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.656800 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.656950 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.657127 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.657127 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.657127 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.657127 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.657127 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.657127 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.657127 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.657127 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.658580 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.658580 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.658580 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.658580 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.658580 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.658580 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.658580 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.658580 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.659782 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.659782 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.659782 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.659782 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.659782 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.659782 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.659782 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.660730 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.660730 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.660730 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.661185 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.662204 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.662757 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.663421 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.664039 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.664580 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.665159 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.665341 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.665492 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.665803 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.666124 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.666434 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.666685 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.666847 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.667068 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.667433 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.667751 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.668066 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.668322 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.668489 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.668713 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.669059 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.669375 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.669697 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.669858 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.670002 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.670303 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.670614 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.670929 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.671241 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.671556 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.671869 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.672177 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.672488 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.672817 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.673062 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.673302 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.673492 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.673815 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.674096 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.674429 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.674747 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.675098 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.675447 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.675664 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.675841 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.676088 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.676408 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.676730 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.677074 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.677260 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.677412 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.677704 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.678024 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.678354 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.678675 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.678890 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.679060 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.679305 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.679641 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.679999 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.680291 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.680604 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.680929 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.681305 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.681649 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.681977 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.682315 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.682624 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.682947 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.683266 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.683445 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.683613 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.683908 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.684227 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.684556 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.684843 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.684944 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.685733 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.686329 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.686857 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.687391 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.687951 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.688484 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.689581 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.689834 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.690191 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.690455 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.690563 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.690805 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.691119 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.691444 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.691784 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.692128 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.692388 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.692497 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.692750 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.693119 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.693439 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.693767 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.694087 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.694403 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.694659 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.694767 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.695023 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.695345 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.695663 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.695983 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.696228 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.696334 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.696601 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.696918 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.697259 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.697574 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.697798 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.697896 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.698210 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.698532 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.698861 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.699065 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.699226 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.699497 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.699809 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.700139 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.700352 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.700460 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.700754 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.701091 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.701407 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.701706 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.701908 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.702185 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.702367 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.702695 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.703040 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.703342 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.703668 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.703995 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.704310 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.705657 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.706209 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.706884 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.707432 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.707991 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.708584 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.709081 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.709392 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.709494 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.709738 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.710065 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.710389 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.710645 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.710745 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.711017 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.711353 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.711674 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.711912 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.712011 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.712298 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.712614 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.712936 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.713300 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.713904 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.714248 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.714465 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.714607 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.714886 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.715219 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.715548 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.715814 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.715923 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.716212 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.716566 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.716881 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.717233 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.717511 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.717617 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.717844 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.718164 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.718479 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.718758 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.718873 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.719085 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.719405 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.719716 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.720053 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.720275 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.720451 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.720690 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.720984 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.721301 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.721623 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.722411 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.722524 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.722752 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.722858 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.723116 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.723428 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.723750 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.724097 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.724410 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.724760 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.725252 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.725801 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.726052 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.726414 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.726730 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.727045 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.727274 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.727383 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.727701 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.727990 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.728302 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.728550 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.728659 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.728920 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.729258 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.729577 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.729857 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.729966 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.730198 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.730516 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.730826 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.731144 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.731430 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.731540 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.731762 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.732078 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.732390 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.732701 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.733049 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.733263 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.733371 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.733661 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.734151 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.734631 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.735023 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.735264 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.735593 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.735944 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.736404 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.736555 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.737044 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.737180 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.737652 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.737779 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.738197 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.738396 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.738741 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.739039 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.739267 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.739686 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.739803 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.740216 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.740422 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.740733 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.741088 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.741276 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.741714 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.741859 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.742227 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.742483 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.742739 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.743118 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.743241 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.743655 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.743841 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.744320 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.744729 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.744993 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.745469 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.745581 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.746050 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.746163 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.746557 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.746763 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.747073 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.747392 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.747724 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.748030 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.748274 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.748644 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.748821 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.749288 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.749419 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.749862 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.750006 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.750469 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.750579 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.750981 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.751190 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.752168 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.752289 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.752733 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.752873 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.753324 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.753523 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.753864 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.754156 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.754639 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.754869 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.755269 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.755675 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.755882 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.756227 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.756541 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.756774 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.757209 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.757321 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.757834 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.757948 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.758398 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.758519 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.758908 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.759142 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.759625 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.759785 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.760220 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.760365 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.760564 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.760727 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.760897 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.761295 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.761550 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.761806 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.762196 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.762318 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.762739 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.762924 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.763251 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.763554 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.763831 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.764183 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.764517 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.764863 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.765003 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.765221 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.765555 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.765897 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.766237 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.766582 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.766742 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.766932 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.767782 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.768148 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.768475 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.768567 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.768800 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.769159 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.769258 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.769483 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.769786 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.769882 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.770118 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.770377 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.770478 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.770749 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.770967 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.771083 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.771377 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.771582 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.771690 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.772215 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.772330 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.772429 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.772636 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.772731 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.772951 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.773294 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.773389 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.773614 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.773874 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.774024 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.774237 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.774700 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.775019 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.775129 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.775336 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.775652 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.775975 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.776076 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.776298 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.776578 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.776673 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.776933 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.777190 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.777311 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.777854 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.777977 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.778068 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.778314 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.778557 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.778664 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.778926 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.779165 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.779274 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.779653 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.779773 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.779863 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.780156 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.780331 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.780478 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.780766 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.780940 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.781166 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.781450 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.781550 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.781967 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.782081 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.782181 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.782483 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.782761 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.782868 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.783238 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.783610 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.783729 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.783829 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.784156 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.784262 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.784831 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.785156 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.785317 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.785436 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.785770 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.786245 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.786364 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.786461 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.786692 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.786953 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.787059 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.787353 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.787501 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.787623 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.788143 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.788271 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.788369 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.788580 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.788907 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.789058 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.789431 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.789541 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.789692 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.791521 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.791643 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.791752 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.791856 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.791945 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.792032 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.792117 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.792216 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.792303 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.792303 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.792464 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.792557 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.792557 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.792557 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.792808 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.794389 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.794518 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.794518 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.794691 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.794793 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.794890 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.794978 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.795064 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.795149 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.795149 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.795149 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.795398 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.795522 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.796030 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.796140 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.796243 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.796460 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.796749 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.796871 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.797126 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.797413 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.797536 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.797717 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.798022 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.798689 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.798899 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.799236 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.799529 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.799639 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.799941 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.800122 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.800230 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.800484 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.800712 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.800818 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.801163 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.801324 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.801499 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.801819 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.801935 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.802186 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.802428 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.802737 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.802853 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.803103 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.803455 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.803574 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.803664 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.803944 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.804212 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.804329 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.804543 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.804914 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.805068 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.805161 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.805490 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.805609 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.807217 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.807217 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.807432 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.807523 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.807523 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.807698 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.807784 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.807877 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.807970 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.807970 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.807970 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.808226 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.808531 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.808712 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.808850 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.809207 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.809528 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.809636 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.809840 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.810156 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.810270 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.810473 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.810748 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.810855 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.811088 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.811393 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.811508 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.811788 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.812431 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.812538 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.812638 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.812733 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.812733 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.812936 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.813176 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.813284 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.814515 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.814856 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.815180 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.815520 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.815812 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.816179 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.816455 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.816762 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.817107 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.817416 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.817736 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.818058 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.818382 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.818766 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.819054 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.819359 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.819471 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.819702 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.820004 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.820340 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.820724 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.821028 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.821155 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.821340 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.822653 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.822784 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.822865 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.822951 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.823037 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.823134 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.823218 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.823218 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.823218 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.823495 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.823748 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.823861 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.824108 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.824401 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.824511 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.824723 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.824902 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.825088 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.825428 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.825535 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.825825 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.826260 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.826367 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.826522 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.826871 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.827930 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.828208 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.828208 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.828406 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.828489 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.828489 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.828704 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.829135 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.830449 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.830568 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.830804 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.831128 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.831228 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.831448 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.831878 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.831990 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.832205 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.832511 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.832618 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.832842 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.833192 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.833303 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.833511 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.833611 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.833940 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.834059 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.834137 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.834212 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.834523 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.834713 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.834840 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.835077 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.835187 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.835413 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.835711 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.835818 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.836075 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.836288 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.836395 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.836704 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.836874 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.837072 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.837370 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.837476 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.837688 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.837931 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.838101 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.838319 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.838489 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.838645 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.838928 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.839252 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.839569 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.839745 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.839907 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.840183 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.840371 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.840530 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.840818 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.841020 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.841183 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.841457 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.841625 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.841791 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.841953 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.842120 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.842371 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.842530 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.842683 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.842896 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.843071 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.843282 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.843450 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.843698 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.844016 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.844176 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.844354 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.844509 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.844669 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.844943 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.845760 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.846026 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.846201 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.846363 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.846519 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.846929 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.847086 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.847330 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.847505 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.847674 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.847826 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.847986 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.848367 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.848935 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.849304 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.849597 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.849930 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.850262 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.850625 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.850957 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.851536 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.852033 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.852373 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.852730 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.853106 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.853542 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.853866 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.854186 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.854523 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.854847 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.855172 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.855355 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.855521 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.855807 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.855985 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.856141 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.856305 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.856459 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.856739 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.856907 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.857102 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.857366 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.857590 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.857756 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.857910 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.858064 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.858296 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.858455 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.858706 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.858992 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.859153 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.859337 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.859505 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.859691 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.860053 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.860224 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.860378 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.860727 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.860898 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.861217 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.861375 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.861527 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.861679 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.861932 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.862111 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.862283 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.862548 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.862717 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.862873 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.863061 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.863230 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.863483 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.863651 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.863924 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.864093 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.864358 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.864533 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.864697 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.864875 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.865212 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.865376 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.865562 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.865732 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.865886 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.866200 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.866369 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.866531 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.866711 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.866881 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.867158 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.867360 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.867599 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.867944 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.868250 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.868419 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.868575 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.868782 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.869089 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.869253 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.869419 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.869574 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.869821 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.869982 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.870152 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.870388 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.870557 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.870712 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.870966 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.871126 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.871292 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.871444 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.871611 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.871773 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.871927 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.872165 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.872326 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.872489 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.872644 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.872798 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.872959 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.873155 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.873318 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.873502 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.873657 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.873812 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.873972 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.874126 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.874278 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.874546 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.874721 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.874721 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.875023 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.875177 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.875340 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.875511 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.875666 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.875819 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.875979 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.876139 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.876333 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.876501 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.876792 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.876953 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.877138 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.877292 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.877459 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.877760 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.877928 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.878083 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.878235 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.878397 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.878706 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.878865 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.879072 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.879234 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.879388 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.879641 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.879802 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.879963 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.880136 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.880290 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.880664 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.880860 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.881151 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.881316 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.881470 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.881631 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.881839 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.882001 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.882175 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.882409 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.882584 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.882747 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.882911 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.883073 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.883237 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.883400 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.883555 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.883707 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.883869 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.884033 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.884193 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.884348 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.884535 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.884805 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.885006 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.885179 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.885343 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.885495 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.885647 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.885809 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.885970 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.886124 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.886276 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.886493 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.886661 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.886840 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.887076 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.887236 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.887423 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.887583 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.887743 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.888064 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.888233 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.888394 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.888571 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.888738 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.889037 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.889235 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.889399 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.889554 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.889706 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.890003 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.890171 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.890355 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.890536 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.890779 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.891011 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.891256 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.891435 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.891589 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.891761 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.892455 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 18:11:38.892689 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.893815 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.893815 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.904937 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.904937 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.904937 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.904937 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.904937 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.904937 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.904937 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.904937 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.906883 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.906883 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.906883 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.906883 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.906883 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.906883 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.906883 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.906883 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.908263 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.908263 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.908263 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.908263 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.908263 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.909376 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.909940 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.910542 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.911335 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.911967 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.912483 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.913160 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.919528 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.919528 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.919528 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.919528 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.919528 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.919528 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.919528 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.919528 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.920110 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.920110 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.920110 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.920110 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.920110 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.920110 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.920110 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.920110 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.920651 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.921426 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.922060 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.922871 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.923539 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.924083 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.924645 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.925115 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.925459 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.925846 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.926130 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.926484 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.926824 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.927169 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.927504 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.927844 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.928178 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.928509 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.928842 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.929493 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.929829 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.930160 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.930489 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.930826 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.931189 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.931518 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.931953 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.933153 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.933153 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.933153 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.933411 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.933725 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.934073 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.934566 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.934908 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.935558 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.935558 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.936630 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.936630 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.936630 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.937076 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.937354 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.937681 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.938022 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.938340 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.938680 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.939484 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.939670 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.939930 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.940264 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.940611 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.941000 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.941351 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.941692 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.942107 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.942735 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.942735 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.943069 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.943253 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.943687 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.943999 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.944355 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.944623 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.944935 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.945280 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.945669 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.945964 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.946288 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.947245 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.947567 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.947887 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.948223 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.948507 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.948827 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.949223 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.949671 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.950006 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.950534 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.950845 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.951065 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.951429 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.951772 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.952087 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.952498 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.952751 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.953110 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.953527 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.954143 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.955013 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.955345 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.955672 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.956022 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.956394 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.956722 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.957072 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.957401 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.957731 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.958110 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.958442 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.958787 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.959107 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.959446 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.959805 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.960141 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.960499 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.960860 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.961230 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.961415 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO dbcounter [None req-796f71b9-1b37-4d34-99e6-a7d95f7af0fa None None] Registered counter for database nova_api Jul 28 18:11:38.961568 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.961869 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.962192 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.962518 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.962841 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.963170 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.963492 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.963958 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.964312 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.964611 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.964954 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.965317 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.965639 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.966667 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.967074 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.967449 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.967780 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.968343 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.968696 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.969047 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.969375 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.969692 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:11:38.969967 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 18:11:38.983293 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_db.sqlalchemy.engines [None req-796f71b9-1b37-4d34-99e6-a7d95f7af0fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118454) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 18:11:38.990899 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writer thread running {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 18:11:39.033176 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO dbcounter [None req-5cd3454e-d33c-4f9e-a6b0-1818996554f3 None None] Registered counter for database nova_api Jul 28 18:11:39.047050 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.context [None req-796f71b9-1b37-4d34-99e6-a7d95f7af0fa None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e78b579e-79d5-47c3-990c-b247b1ada0c9(cell1) {{(pid=118454) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 18:11:39.052611 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-796f71b9-1b37-4d34-99e6-a7d95f7af0fa None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:39.053539 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-796f71b9-1b37-4d34-99e6-a7d95f7af0fa None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:39.053721 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_db.sqlalchemy.engines [None req-5cd3454e-d33c-4f9e-a6b0-1818996554f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 18:11:39.054493 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-796f71b9-1b37-4d34-99e6-a7d95f7af0fa None None] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:39.056568 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-796f71b9-1b37-4d34-99e6-a7d95f7af0fa None None] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:39.058605 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO dbcounter [None req-796f71b9-1b37-4d34-99e6-a7d95f7af0fa None None] Registered counter for database nova_cell0 Jul 28 18:11:39.060556 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writer thread running {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 18:11:39.062696 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO dbcounter [None req-796f71b9-1b37-4d34-99e6-a7d95f7af0fa None None] Registered counter for database nova_cell1 Jul 28 18:11:39.070763 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_db.sqlalchemy.engines [None req-796f71b9-1b37-4d34-99e6-a7d95f7af0fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118454) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 18:11:39.073114 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_db.sqlalchemy.engines [None req-796f71b9-1b37-4d34-99e6-a7d95f7af0fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118454) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 18:11:39.077619 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writer thread running {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 18:11:39.117262 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.context [None req-5cd3454e-d33c-4f9e-a6b0-1818996554f3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e78b579e-79d5-47c3-990c-b247b1ada0c9(cell1) {{(pid=118453) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 18:11:39.121407 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5cd3454e-d33c-4f9e-a6b0-1818996554f3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:39.123031 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5cd3454e-d33c-4f9e-a6b0-1818996554f3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:39.123841 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5cd3454e-d33c-4f9e-a6b0-1818996554f3 None None] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:39.125892 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5cd3454e-d33c-4f9e-a6b0-1818996554f3 None None] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:39.128462 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO dbcounter [None req-5cd3454e-d33c-4f9e-a6b0-1818996554f3 None None] Registered counter for database nova_cell0 Jul 28 18:11:39.132548 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO dbcounter [None req-5cd3454e-d33c-4f9e-a6b0-1818996554f3 None None] Registered counter for database nova_cell1 Jul 28 18:11:39.139779 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_db.sqlalchemy.engines [None req-5cd3454e-d33c-4f9e-a6b0-1818996554f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 18:11:39.141557 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_db.sqlalchemy.engines [None req-5cd3454e-d33c-4f9e-a6b0-1818996554f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 18:11:39.147172 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writer thread running {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 18:11:39.152547 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writer thread running {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 18:11:39.232207 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writer thread running {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 18:11:39.243149 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO dbcounter [None req-796f71b9-1b37-4d34-99e6-a7d95f7af0fa None None] Registered counter for database nova_cell0 Jul 28 18:11:39.250892 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_db.sqlalchemy.engines [None req-796f71b9-1b37-4d34-99e6-a7d95f7af0fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118454) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 18:11:39.255797 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writer thread running {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 18:11:39.302035 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO dbcounter [None req-5cd3454e-d33c-4f9e-a6b0-1818996554f3 None None] Registered counter for database nova_cell0 Jul 28 18:11:39.308817 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_db.sqlalchemy.engines [None req-5cd3454e-d33c-4f9e-a6b0-1818996554f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 18:11:39.313220 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writer thread running {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 18:11:39.588666 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: WARNING keystonemiddleware.auth_token [None req-796f71b9-1b37-4d34-99e6-a7d95f7af0fa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 18:11:39.596163 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: WARNING keystonemiddleware.auth_token [None req-796f71b9-1b37-4d34-99e6-a7d95f7af0fa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 18:11:39.638016 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: WARNING keystonemiddleware.auth_token [None req-5cd3454e-d33c-4f9e-a6b0-1818996554f3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 18:11:39.645353 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: WARNING keystonemiddleware.auth_token [None req-5cd3454e-d33c-4f9e-a6b0-1818996554f3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 18:11:39.941606 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: WARNING keystonemiddleware.auth_token [None req-796f71b9-1b37-4d34-99e6-a7d95f7af0fa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 18:11:39.947561 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: WARNING keystonemiddleware.auth_token [None req-796f71b9-1b37-4d34-99e6-a7d95f7af0fa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 18:11:39.953636 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x560909e9b9c0 pid: 118454 (default app) Jul 28 18:11:39.989071 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: WARNING keystonemiddleware.auth_token [None req-5cd3454e-d33c-4f9e-a6b0-1818996554f3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 18:11:39.995063 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: WARNING keystonemiddleware.auth_token [None req-5cd3454e-d33c-4f9e-a6b0-1818996554f3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 18:11:40.000459 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x560909e9b9c0 pid: 118453 (default app) Jul 28 18:12:23.532087 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_api:SELECT=3 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:12:23.532087 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell1:SELECT=3 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:12:23.532087 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell0:SELECT=3 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:12:23.532087 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell0:SELECT=3 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:12:25.059682 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-168b2927-dbcc-4134-8fa0-57c43a1bef45 tempest-VolumesGetTestJSON-474447254 tempest-VolumesGetTestJSON-474447254-project] Action: 'create', calling method: .version_select at 0x7f6fe44d5ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-167218728", "metadata": {"Type": "work"}}} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:12:27.321108 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-168b2927-dbcc-4134-8fa0-57c43a1bef45 tempest-VolumesGetTestJSON-474447254 tempest-VolumesGetTestJSON-474447254-project] 10.222.0.86 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.801664 Jul 28 18:12:27.322761 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 1/1] 10.222.0.86 () {60 vars in 1156 bytes} [Thu Jul 28 18:12:23 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3805 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 28 18:12:27.343008 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=3 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:12:27.343008 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell0:SELECT=3 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:12:27.344602 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=3 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:12:27.346170 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell0:SELECT=3 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:12:27.774048 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-04d38ec7-9719-4a57-a2bc-7f1e2e92d942 tempest-VolumesGetTestJSON-474447254 tempest-VolumesGetTestJSON-474447254-project] Calling method '.version_select at 0x7f6fe44a58b0>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:28.503847 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-04d38ec7-9719-4a57-a2bc-7f1e2e92d942 tempest-VolumesGetTestJSON-474447254 tempest-VolumesGetTestJSON-474447254-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/8474fe07-b318-4a9f-af78-7eae9a0e7bd6" status: 200 len: 352 microversion: 2.1 time: 1.168673 Jul 28 18:12:28.504706 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 1/2] 10.222.0.86 () {58 vars in 1245 bytes} [Thu Jul 28 18:12:27 2022] GET /compute/v2.1/os-volumes/8474fe07-b318-4a9f-af78-7eae9a0e7bd6 => generated 352 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:12:29.519013 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-bffea6a4-6e24-429d-95d3-2b587165fc37 tempest-VolumesGetTestJSON-474447254 tempest-VolumesGetTestJSON-474447254-project] Calling method '.version_select at 0x7f6fe4330af0>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:29.682800 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-bffea6a4-6e24-429d-95d3-2b587165fc37 tempest-VolumesGetTestJSON-474447254 tempest-VolumesGetTestJSON-474447254-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/8474fe07-b318-4a9f-af78-7eae9a0e7bd6" status: 200 len: 353 microversion: 2.1 time: 0.167625 Jul 28 18:12:29.682800 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 2/3] 10.222.0.86 () {58 vars in 1245 bytes} [Thu Jul 28 18:12:29 2022] GET /compute/v2.1/os-volumes/8474fe07-b318-4a9f-af78-7eae9a0e7bd6 => generated 353 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:12:29.699291 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-8f4661d3-9e3d-46aa-b283-78ea043274a4 tempest-VolumesGetTestJSON-474447254 tempest-VolumesGetTestJSON-474447254-project] Calling method '.version_select at 0x7f6fe4368af0>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:29.870227 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-8f4661d3-9e3d-46aa-b283-78ea043274a4 tempest-VolumesGetTestJSON-474447254 tempest-VolumesGetTestJSON-474447254-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/8474fe07-b318-4a9f-af78-7eae9a0e7bd6" status: 200 len: 353 microversion: 2.1 time: 0.176746 Jul 28 18:12:29.880803 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 2/4] 10.222.0.86 () {58 vars in 1245 bytes} [Thu Jul 28 18:12:29 2022] GET /compute/v2.1/os-volumes/8474fe07-b318-4a9f-af78-7eae9a0e7bd6 => generated 353 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:12:29.901233 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-31d1bd31-5779-4dda-ac3f-40df3cac191f tempest-VolumesGetTestJSON-474447254 tempest-VolumesGetTestJSON-474447254-project] Calling method '.version_select at 0x7f6fe43411f0>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:30.266222 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-31d1bd31-5779-4dda-ac3f-40df3cac191f tempest-VolumesGetTestJSON-474447254 tempest-VolumesGetTestJSON-474447254-project] 10.222.0.86 "DELETE /compute/v2.1/os-volumes/8474fe07-b318-4a9f-af78-7eae9a0e7bd6" status: 202 len: 0 microversion: 2.1 time: 0.369169 Jul 28 18:12:30.266810 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 3/5] 10.222.0.86 () {58 vars in 1248 bytes} [Thu Jul 28 18:12:29 2022] DELETE /compute/v2.1/os-volumes/8474fe07-b318-4a9f-af78-7eae9a0e7bd6 => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 18:12:30.275431 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-785b0780-d2b0-4625-90a5-15a0b5eca0d0 tempest-VolumesGetTestJSON-474447254 tempest-VolumesGetTestJSON-474447254-project] Calling method '.version_select at 0x7f6fe43251f0>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:30.371156 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-785b0780-d2b0-4625-90a5-15a0b5eca0d0 tempest-VolumesGetTestJSON-474447254 tempest-VolumesGetTestJSON-474447254-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/8474fe07-b318-4a9f-af78-7eae9a0e7bd6" status: 200 len: 352 microversion: 2.1 time: 0.097767 Jul 28 18:12:30.371156 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 3/6] 10.222.0.86 () {58 vars in 1245 bytes} [Thu Jul 28 18:12:30 2022] GET /compute/v2.1/os-volumes/8474fe07-b318-4a9f-af78-7eae9a0e7bd6 => generated 352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:12:31.384497 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-74d8dd33-116c-4efa-bb51-fa7848498f5b tempest-VolumesGetTestJSON-474447254 tempest-VolumesGetTestJSON-474447254-project] Calling method '.version_select at 0x7f6fe43418b0>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:32.064329 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-1cbb1d91-7153-4baf-a74b-b9e12b3adc0e tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-298041078", "imageRef": "61912422-61cd-4ced-a573-85ee305e010f", "flavorRef": "452", "networks": [{"uuid": "5491f7c1-3602-41e0-a191-959322e022d6"}]}} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:12:32.243845 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.wsgi [None req-74d8dd33-116c-4efa-bb51-fa7848498f5b tempest-VolumesGetTestJSON-474447254 tempest-VolumesGetTestJSON-474447254-project] HTTP exception thrown: Volume 8474fe07-b318-4a9f-af78-7eae9a0e7bd6 could not be found. Jul 28 18:12:32.251420 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-74d8dd33-116c-4efa-bb51-fa7848498f5b tempest-VolumesGetTestJSON-474447254 tempest-VolumesGetTestJSON-474447254-project] Request method failure captured: Jul 28 18:12:32.251420 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: request: GET /compute/v2.1/os-volumes/8474fe07-b318-4a9f-af78-7eae9a0e7bd6 HTTP/1.1 Jul 28 18:12:32.251420 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Accept: application/json Jul 28 18:12:32.251420 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Accept-Encoding: identity Jul 28 18:12:32.251420 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Connection: close Jul 28 18:12:32.251420 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Content-Length: 0 Jul 28 18:12:32.251420 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Content-Type: application/json Jul 28 18:12:32.251420 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Host: 10.222.0.86 Jul 28 18:12:32.251420 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Openstack-System-Scope: None Jul 28 18:12:32.251420 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: User-Agent: python-urllib3/1.26.10 Jul 28 18:12:32.251420 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Auth-Token: gAAAAABi4tGHv_Thcy6rqDTBlbhp6Il0ZVg2ikU9UiL6PeL2BKeum2-y6pPvfizgGXDheXtExuCTrJrzkXOygy3PfBxQSB5oEPBzLf66QyuHruyWmfolu00T3cUqM9nXfsHVzisnODziksRta4p1p6OFxWZzRK4N2CMwiLjaGZuYwbakJVWHxYs Jul 28 18:12:32.251420 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Domain-Id: None Jul 28 18:12:32.251420 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Domain-Name: None Jul 28 18:12:32.251420 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Identity-Status: Confirmed Jul 28 18:12:32.251420 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Is-Admin-Project: True Jul 28 18:12:32.251420 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Domain-Id: default Jul 28 18:12:32.251420 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Domain-Name: Default Jul 28 18:12:32.251420 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Id: 79a097f0698e4b0fa113b651a01051b7 Jul 28 18:12:32.251420 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Name: tempest-VolumesGetTestJSON-474447254 Jul 28 18:12:32.251420 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Role: member,reader Jul 28 18:12:32.251420 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Roles: member,reader Jul 28 18:12:32.252444 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_79a097f0698e4b0fa113b651a01051b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/79a097f0698e4b0fa113b651a01051b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/79a097f0698e4b0fa113b651a01051b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/79a097f0698e4b0fa113b651a01051b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}] Jul 28 18:12:32.252444 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant: tempest-VolumesGetTestJSON-474447254 Jul 28 18:12:32.252444 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant-Id: 79a097f0698e4b0fa113b651a01051b7 Jul 28 18:12:32.252444 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant-Name: tempest-VolumesGetTestJSON-474447254 Jul 28 18:12:32.252444 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User: tempest-VolumesGetTestJSON-474447254-project Jul 28 18:12:32.252444 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Domain-Id: default Jul 28 18:12:32.252444 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Domain-Name: Default Jul 28 18:12:32.252444 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Id: a4e1efaae5184880a180d4eda894426e Jul 28 18:12:32.252444 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Name: tempest-VolumesGetTestJSON-474447254-project Jul 28 18:12:32.252444 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: method: Jul 28 18:12:32.252444 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: exception: Volume 8474fe07-b318-4a9f-af78-7eae9a0e7bd6 could not be found. Jul 28 18:12:32.252444 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: action_args: {'id': '8474fe07-b318-4a9f-af78-7eae9a0e7bd6'} Jul 28 18:12:32.252444 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:12:32.253358 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:12:32.253358 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 18:12:32.253358 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 18:12:32.253358 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 18:12:32.253358 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 18:12:32.253358 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 18:12:32.253358 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 18:12:32.253358 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 18:12:32.253358 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 18:12:32.253358 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 18:12:32.253358 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 18:12:32.253358 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 18:12:32.253358 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 18:12:32.253358 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 18:12:32.253358 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 18:12:32.253358 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8474fe07-b318-4a9f-af78-7eae9a0e7bd6 could not be found. (HTTP 404) (Request-ID: req-3c45cd9d-5329-4197-8454-b687758f24da) Jul 28 18:12:32.253358 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:12:32.253358 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:12:32.253358 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:12:32.254209 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:12:32.254209 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 28 18:12:32.254209 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 28 18:12:32.254209 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 18:12:32.254209 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 18:12:32.254209 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 18:12:32.254209 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 18:12:32.254209 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 18:12:32.254209 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 18:12:32.254209 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 18:12:32.254209 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 18:12:32.254209 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 18:12:32.254209 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 18:12:32.254209 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 18:12:32.254209 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 18:12:32.254209 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 18:12:32.254209 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 18:12:32.254209 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 18:12:32.254209 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 18:12:32.255045 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 18:12:32.255045 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 18:12:32.255045 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 18:12:32.255045 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 18:12:32.255045 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8474fe07-b318-4a9f-af78-7eae9a0e7bd6 could not be found. Jul 28 18:12:32.255045 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:12:32.255045 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:12:32.255045 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:12:32.255045 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:12:32.255045 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:12:32.255045 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:12:32.255045 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:12:32.255045 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:12:32.255045 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 18:12:32.255045 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 18:12:32.255045 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:12:32.255045 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:12:32.255045 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 28 18:12:32.255045 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:12:32.257386 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8474fe07-b318-4a9f-af78-7eae9a0e7bd6 could not be found. Jul 28 18:12:32.257386 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:12:32.257386 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:12:32.257386 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:12:32.257386 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:12:32.257386 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:12:32.257386 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:12:32.257386 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:12:32.257386 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:12:32.257386 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8474fe07-b318-4a9f-af78-7eae9a0e7bd6 could not be found. Jul 28 18:12:32.257386 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:12:32.257386 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-74d8dd33-116c-4efa-bb51-fa7848498f5b tempest-VolumesGetTestJSON-474447254 tempest-VolumesGetTestJSON-474447254-project] Returning 404 to user: Volume 8474fe07-b318-4a9f-af78-7eae9a0e7bd6 could not be found. {{(pid=118454) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:12:32.257386 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-74d8dd33-116c-4efa-bb51-fa7848498f5b tempest-VolumesGetTestJSON-474447254 tempest-VolumesGetTestJSON-474447254-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/8474fe07-b318-4a9f-af78-7eae9a0e7bd6" status: 404 len: 109 microversion: 2.1 time: 0.874605 Jul 28 18:12:32.276564 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 4/7] 10.222.0.86 () {58 vars in 1245 bytes} [Thu Jul 28 18:12:31 2022] GET /compute/v2.1/os-volumes/8474fe07-b318-4a9f-af78-7eae9a0e7bd6 => generated 109 bytes in 892 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:12:32.315954 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.network.neutron [None req-1cbb1d91-7153-4baf-a74b-b9e12b3adc0e tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] validate_networks() for [('5491f7c1-3602-41e0-a191-959322e022d6', None, None, None, None, None)] {{(pid=118453) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 18:12:34.258810 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-1cbb1d91-7153-4baf-a74b-b9e12b3adc0e tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Flavor limits 0:0:0 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 18:12:34.259364 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-1cbb1d91-7153-4baf-a74b-b9e12b3adc0e tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Image limits 0:0:0 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 18:12:34.260259 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-1cbb1d91-7153-4baf-a74b-b9e12b3adc0e tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Flavor pref 0:0:0 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 18:12:34.260779 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-1cbb1d91-7153-4baf-a74b-b9e12b3adc0e tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Image pref 0:0:0 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 18:12:34.261391 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-1cbb1d91-7153-4baf-a74b-b9e12b3adc0e tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 18:12:34.299314 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1cbb1d91-7153-4baf-a74b-b9e12b3adc0e tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:34.299314 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1cbb1d91-7153-4baf-a74b-b9e12b3adc0e tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:34.299314 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1cbb1d91-7153-4baf-a74b-b9e12b3adc0e tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:34.299314 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1cbb1d91-7153-4baf-a74b-b9e12b3adc0e tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:34.396648 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.quota [None req-1cbb1d91-7153-4baf-a74b-b9e12b3adc0e tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Getting quotas for project 8ef52881d75f407a942bf960230ea22e. Resources: {'cores', 'ram', 'instances'} {{(pid=118453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 18:12:34.431962 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.quota [None req-1cbb1d91-7153-4baf-a74b-b9e12b3adc0e tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Getting quotas for user d96e9a9e40c54b6a9a7f8560e4846be5 and project 8ef52881d75f407a942bf960230ea22e. Resources: {'cores', 'ram', 'instances'} {{(pid=118453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 18:12:34.464504 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-1cbb1d91-7153-4baf-a74b-b9e12b3adc0e tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Going to run 1 instances... {{(pid=118453) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 18:12:34.468878 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-1cbb1d91-7153-4baf-a74b-b9e12b3adc0e tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='61912422-61cd-4ced-a573-85ee305e010f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 18:12:34.673405 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-1cbb1d91-7153-4baf-a74b-b9e12b3adc0e tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.814584 Jul 28 18:12:34.675127 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 4/8] 10.222.0.86 () {60 vars in 1147 bytes} [Thu Jul 28 18:12:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2817 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 18:12:34.688542 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-d82bc743-8d75-4355-9172-da3b47ecc1bb tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:34.691035 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-d82bc743-8d75-4355-9172-da3b47ecc1bb tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:34.970084 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-d82bc743-8d75-4355-9172-da3b47ecc1bb tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96e9a9e40c54b6a9a7f8560e4846be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef52881d75f407a942bf960230ea22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:34.997892 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-d82bc743-8d75-4355-9172-da3b47ecc1bb tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436" status: 200 len: 1214 microversion: 2.1 time: 0.314859 Jul 28 18:12:35.003240 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 5/9] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:12:34 2022] GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 => generated 1214 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:12:36.025490 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-2bc62c09-7974-41b4-9e48-79009ebed739 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:36.026300 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-2bc62c09-7974-41b4-9e48-79009ebed739 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:36.299105 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-2bc62c09-7974-41b4-9e48-79009ebed739 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96e9a9e40c54b6a9a7f8560e4846be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef52881d75f407a942bf960230ea22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:36.328411 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-2bc62c09-7974-41b4-9e48-79009ebed739 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436" status: 200 len: 1214 microversion: 2.1 time: 0.308364 Jul 28 18:12:36.329503 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 5/10] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:12:36 2022] GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 => generated 1214 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:12:37.360056 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-36edb8fb-e5b9-42fc-aab5-f39c66f3bf1a tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:37.366706 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-36edb8fb-e5b9-42fc-aab5-f39c66f3bf1a tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:37.729484 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-36edb8fb-e5b9-42fc-aab5-f39c66f3bf1a tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96e9a9e40c54b6a9a7f8560e4846be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef52881d75f407a942bf960230ea22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:37.738014 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-36edb8fb-e5b9-42fc-aab5-f39c66f3bf1a tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436" status: 200 len: 1214 microversion: 2.1 time: 0.389318 Jul 28 18:12:37.750303 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 6/11] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:12:37 2022] GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 => generated 1214 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:12:38.770551 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ef21842c-1a4d-415b-a8fe-6c8c1fa317d0 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:38.771854 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ef21842c-1a4d-415b-a8fe-6c8c1fa317d0 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:38.800743 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ef21842c-1a4d-415b-a8fe-6c8c1fa317d0 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:38.800743 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ef21842c-1a4d-415b-a8fe-6c8c1fa317d0 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:38.801921 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ef21842c-1a4d-415b-a8fe-6c8c1fa317d0 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:38.802607 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ef21842c-1a4d-415b-a8fe-6c8c1fa317d0 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:39.368768 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ef21842c-1a4d-415b-a8fe-6c8c1fa317d0 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96e9a9e40c54b6a9a7f8560e4846be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef52881d75f407a942bf960230ea22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:39.397097 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ef21842c-1a4d-415b-a8fe-6c8c1fa317d0 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436" status: 200 len: 1218 microversion: 2.1 time: 0.632679 Jul 28 18:12:39.412658 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 6/12] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:12:38 2022] GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 => generated 1218 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:12:40.427861 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-97e59982-0135-4ee7-b65a-4589c352734a tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:40.429416 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-97e59982-0135-4ee7-b65a-4589c352734a tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:40.446663 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-97e59982-0135-4ee7-b65a-4589c352734a tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:40.451483 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-97e59982-0135-4ee7-b65a-4589c352734a tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:40.453266 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-97e59982-0135-4ee7-b65a-4589c352734a tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:40.456384 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-97e59982-0135-4ee7-b65a-4589c352734a tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:40.666322 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-97e59982-0135-4ee7-b65a-4589c352734a tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96e9a9e40c54b6a9a7f8560e4846be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef52881d75f407a942bf960230ea22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:40.682147 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-97e59982-0135-4ee7-b65a-4589c352734a tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436" status: 200 len: 1274 microversion: 2.1 time: 0.263720 Jul 28 18:12:40.698144 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 7/13] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:12:40 2022] GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 => generated 1274 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:12:41.473481 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-a907ee3e-026f-4532-b8cc-920c3e61e9be tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Action: 'create', calling method: .version_select at 0x7f6fe4269f70>, body: {"keypair": {"name": "tempest-keypair-777318939", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMqumGXFdE9/H3soTGivxwGLMdMSuJAaCJb3mGfWHvaHX/zDcyivq+I7VupgXku7CiH24KsLC6V5AQeWTsTQntSqwMuWkIhUOzvqK3RiRCL7LzoZTNdQgM9pA7hPdB0JCA=="}} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:12:41.664162 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.quota [None req-a907ee3e-026f-4532-b8cc-920c3e61e9be tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Getting quotas for project 9e962e97777048b79415ba13adcc95be. Resources: {'key_pairs'} {{(pid=118454) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 18:12:41.688924 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.quota [None req-a907ee3e-026f-4532-b8cc-920c3e61e9be tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Getting quotas for user ca7d773290a9483d91ebefad341addee and project 9e962e97777048b79415ba13adcc95be. Resources: {'key_pairs'} {{(pid=118454) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 18:12:41.705316 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-56e6f3ba-3a29-4803-b6e0-022e34efb852 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Action: 'create', calling method: .version_select at 0x7f6fe3136a60>, body: {"keypair": {"name": "tempest-keypair-343976042", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD9znVs0xS0DsdMHxRThTShrCBkTyJyDNhTREp+Va/dHVEtyLXQkZqKKYy9jAWZxUQhkfJzuTC13mVUNn7EgkLhE2J+c6oMSTZIOX0XKGg6ovgBwhZUlJ/LhzYtzh4croA=="}} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:12:41.791359 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.quota [None req-56e6f3ba-3a29-4803-b6e0-022e34efb852 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Getting quotas for project 27b91f25d2be408ba9e8d667a574a7a9. Resources: {'key_pairs'} {{(pid=118453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 18:12:41.800095 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.quota [None req-56e6f3ba-3a29-4803-b6e0-022e34efb852 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Getting quotas for user b9874df18af245688db1137b6f1b0bff and project 27b91f25d2be408ba9e8d667a574a7a9. Resources: {'key_pairs'} {{(pid=118453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 18:12:41.887291 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-a907ee3e-026f-4532-b8cc-920c3e61e9be tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.547789 Jul 28 18:12:41.888491 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 7/14] 10.222.0.86 () {62 vars in 1200 bytes} [Thu Jul 28 18:12:40 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1551 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 28 18:12:41.897687 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-a6a3c7f5-a24d-46c9-9717-1427ee15a6a6 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:41.899182 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-a6a3c7f5-a24d-46c9-9717-1427ee15a6a6 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:41.922989 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a6a3c7f5-a24d-46c9-9717-1427ee15a6a6 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:41.924412 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a6a3c7f5-a24d-46c9-9717-1427ee15a6a6 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:41.930921 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a6a3c7f5-a24d-46c9-9717-1427ee15a6a6 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:41.931747 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a6a3c7f5-a24d-46c9-9717-1427ee15a6a6 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:41.943672 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-56e6f3ba-3a29-4803-b6e0-022e34efb852 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.719844 Jul 28 18:12:41.944795 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 8/15] 10.222.0.86 () {60 vars in 1159 bytes} [Thu Jul 28 18:12:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:12:42.367142 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-a6a3c7f5-a24d-46c9-9717-1427ee15a6a6 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96e9a9e40c54b6a9a7f8560e4846be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef52881d75f407a942bf960230ea22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:42.392660 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-a6a3c7f5-a24d-46c9-9717-1427ee15a6a6 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436" status: 200 len: 1272 microversion: 2.1 time: 0.502690 Jul 28 18:12:42.393409 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 8/16] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:12:41 2022] GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 => generated 1272 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:12:43.066901 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-af6332c4-781d-452d-bbb8-a43e71ba1b42 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-925977532", "imageRef": "61912422-61cd-4ced-a573-85ee305e010f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:12:43.201109 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.network.neutron [None req-af6332c4-781d-452d-bbb8-a43e71ba1b42 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] validate_networks() for [('ba65b4a3-37f5-43f6-818c-5327e758cd5c', None, None, None, None, None)] {{(pid=118453) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 18:12:43.417292 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-16f8427d-42f1-4c1b-9aca-6d69f957af1e tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:43.418687 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-16f8427d-42f1-4c1b-9aca-6d69f957af1e tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:43.433794 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-16f8427d-42f1-4c1b-9aca-6d69f957af1e tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:43.434353 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-16f8427d-42f1-4c1b-9aca-6d69f957af1e tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:43.437723 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-16f8427d-42f1-4c1b-9aca-6d69f957af1e tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:43.438887 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-16f8427d-42f1-4c1b-9aca-6d69f957af1e tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:43.738044 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-16f8427d-42f1-4c1b-9aca-6d69f957af1e tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96e9a9e40c54b6a9a7f8560e4846be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef52881d75f407a942bf960230ea22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:43.754493 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-16f8427d-42f1-4c1b-9aca-6d69f957af1e tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436" status: 200 len: 1272 microversion: 2.1 time: 0.342527 Jul 28 18:12:43.758845 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 9/17] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:12:43 2022] GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 => generated 1272 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:12:44.342488 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell0:SELECT=2 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:12:44.666732 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-af6332c4-781d-452d-bbb8-a43e71ba1b42 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Flavor limits 0:0:0 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 18:12:44.667191 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-af6332c4-781d-452d-bbb8-a43e71ba1b42 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Image limits 0:0:0 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 18:12:44.667891 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-af6332c4-781d-452d-bbb8-a43e71ba1b42 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Flavor pref 0:0:0 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 18:12:44.668300 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-af6332c4-781d-452d-bbb8-a43e71ba1b42 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Image pref 0:0:0 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 18:12:44.668732 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-af6332c4-781d-452d-bbb8-a43e71ba1b42 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 18:12:44.709702 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-af6332c4-781d-452d-bbb8-a43e71ba1b42 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:44.710355 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-af6332c4-781d-452d-bbb8-a43e71ba1b42 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:44.712803 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-af6332c4-781d-452d-bbb8-a43e71ba1b42 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:44.722582 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-af6332c4-781d-452d-bbb8-a43e71ba1b42 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:44.771481 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.quota [None req-af6332c4-781d-452d-bbb8-a43e71ba1b42 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Getting quotas for project b52f26ab8b934756b0c74d681d08d04f. Resources: {'cores', 'ram', 'instances'} {{(pid=118453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 18:12:44.784845 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-fc6e73c6-a4c0-415d-a0c7-049b78490927 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:44.785506 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-fc6e73c6-a4c0-415d-a0c7-049b78490927 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:44.799948 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.quota [None req-af6332c4-781d-452d-bbb8-a43e71ba1b42 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Getting quotas for user 5ef698c4f57f44d387550921a288d7ab and project b52f26ab8b934756b0c74d681d08d04f. Resources: {'cores', 'ram', 'instances'} {{(pid=118453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 18:12:44.803088 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-fc6e73c6-a4c0-415d-a0c7-049b78490927 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:44.803884 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-fc6e73c6-a4c0-415d-a0c7-049b78490927 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:44.806108 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-fc6e73c6-a4c0-415d-a0c7-049b78490927 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:44.813900 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-fc6e73c6-a4c0-415d-a0c7-049b78490927 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:44.848857 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-af6332c4-781d-452d-bbb8-a43e71ba1b42 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Going to run 1 instances... {{(pid=118453) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 18:12:44.853151 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-af6332c4-781d-452d-bbb8-a43e71ba1b42 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='61912422-61cd-4ced-a573-85ee305e010f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 18:12:44.962202 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-fc6e73c6-a4c0-415d-a0c7-049b78490927 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96e9a9e40c54b6a9a7f8560e4846be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef52881d75f407a942bf960230ea22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:44.972126 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-fc6e73c6-a4c0-415d-a0c7-049b78490927 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436" status: 200 len: 1272 microversion: 2.1 time: 0.193265 Jul 28 18:12:44.973227 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 10/18] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:12:44 2022] GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 => generated 1272 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:12:45.119312 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-af6332c4-781d-452d-bbb8-a43e71ba1b42 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.320979 Jul 28 18:12:45.132268 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 9/19] 10.222.0.86 () {60 vars in 1147 bytes} [Thu Jul 28 18:12:42 2022] POST /compute/v2.1/servers => generated 383 bytes in 2334 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 18:12:45.146190 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-cbda0ff0-3e98-44ec-9955-3f9f2cda9102 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:45.146832 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-cbda0ff0-3e98-44ec-9955-3f9f2cda9102 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:45.857549 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-cbda0ff0-3e98-44ec-9955-3f9f2cda9102 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:45.867791 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-cbda0ff0-3e98-44ec-9955-3f9f2cda9102 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1" status: 200 len: 1221 microversion: 2.1 time: 0.726145 Jul 28 18:12:45.872458 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 11/20] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:12:45 2022] GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 => generated 1221 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:12:45.995081 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-945f1c9f-7bd5-4438-bd72-d74d94c342d8 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:45.996735 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-945f1c9f-7bd5-4438-bd72-d74d94c342d8 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:46.034954 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-945f1c9f-7bd5-4438-bd72-d74d94c342d8 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:46.042771 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-945f1c9f-7bd5-4438-bd72-d74d94c342d8 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:46.045682 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-945f1c9f-7bd5-4438-bd72-d74d94c342d8 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:46.051607 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-945f1c9f-7bd5-4438-bd72-d74d94c342d8 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:46.328433 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-76e15070-06cd-45be-904c-06c4c9cd6fa7 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1470067085", "imageRef": "61912422-61cd-4ced-a573-85ee305e010f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:12:46.495960 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.network.neutron [None req-76e15070-06cd-45be-904c-06c4c9cd6fa7 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] validate_networks() for [('ba65b4a3-37f5-43f6-818c-5327e758cd5c', None, None, None, None, None)] {{(pid=118454) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 18:12:46.701116 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-945f1c9f-7bd5-4438-bd72-d74d94c342d8 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96e9a9e40c54b6a9a7f8560e4846be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef52881d75f407a942bf960230ea22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:46.743077 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-945f1c9f-7bd5-4438-bd72-d74d94c342d8 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436" status: 200 len: 1314 microversion: 2.1 time: 0.752235 Jul 28 18:12:46.745675 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 10/21] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:12:45 2022] GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 => generated 1314 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:12:47.773780 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-cabf0686-5aa9-4610-80d8-6d988b226bee tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:47.784080 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-cabf0686-5aa9-4610-80d8-6d988b226bee tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:47.793410 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cabf0686-5aa9-4610-80d8-6d988b226bee tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:47.794755 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cabf0686-5aa9-4610-80d8-6d988b226bee tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:47.797392 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cabf0686-5aa9-4610-80d8-6d988b226bee tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:47.798571 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cabf0686-5aa9-4610-80d8-6d988b226bee tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:48.295911 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-cabf0686-5aa9-4610-80d8-6d988b226bee tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96e9a9e40c54b6a9a7f8560e4846be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef52881d75f407a942bf960230ea22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:48.315099 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-cabf0686-5aa9-4610-80d8-6d988b226bee tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436" status: 200 len: 1314 microversion: 2.1 time: 0.547532 Jul 28 18:12:48.315260 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 11/22] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:12:47 2022] GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 => generated 1314 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:12:48.463338 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.virt.hardware [None req-76e15070-06cd-45be-904c-06c4c9cd6fa7 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Flavor limits 0:0:0 {{(pid=118454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 18:12:48.463951 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.virt.hardware [None req-76e15070-06cd-45be-904c-06c4c9cd6fa7 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Image limits 0:0:0 {{(pid=118454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 18:12:48.464239 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.virt.hardware [None req-76e15070-06cd-45be-904c-06c4c9cd6fa7 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Flavor pref 0:0:0 {{(pid=118454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 18:12:48.464660 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.virt.hardware [None req-76e15070-06cd-45be-904c-06c4c9cd6fa7 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Image pref 0:0:0 {{(pid=118454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 18:12:48.465332 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.virt.hardware [None req-76e15070-06cd-45be-904c-06c4c9cd6fa7 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 18:12:48.488573 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-76e15070-06cd-45be-904c-06c4c9cd6fa7 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:48.488573 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-76e15070-06cd-45be-904c-06c4c9cd6fa7 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:48.488573 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-76e15070-06cd-45be-904c-06c4c9cd6fa7 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:48.488573 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-76e15070-06cd-45be-904c-06c4c9cd6fa7 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:48.541793 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.quota [None req-76e15070-06cd-45be-904c-06c4c9cd6fa7 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Getting quotas for project b52f26ab8b934756b0c74d681d08d04f. Resources: {'cores', 'ram', 'instances'} {{(pid=118454) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 18:12:48.551243 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.quota [None req-76e15070-06cd-45be-904c-06c4c9cd6fa7 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Getting quotas for user 5ef698c4f57f44d387550921a288d7ab and project b52f26ab8b934756b0c74d681d08d04f. Resources: {'cores', 'ram', 'instances'} {{(pid=118454) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 18:12:48.572458 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-76e15070-06cd-45be-904c-06c4c9cd6fa7 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Going to run 1 instances... {{(pid=118454) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 18:12:48.576063 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-76e15070-06cd-45be-904c-06c4c9cd6fa7 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='61912422-61cd-4ced-a573-85ee305e010f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118454) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 18:12:48.739443 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-76e15070-06cd-45be-904c-06c4c9cd6fa7 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.418069 Jul 28 18:12:48.746811 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 12/23] 10.222.0.86 () {60 vars in 1147 bytes} [Thu Jul 28 18:12:46 2022] POST /compute/v2.1/servers => generated 383 bytes in 2426 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 18:12:48.751111 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5bec1dcb-33a2-4038-ba39-b8dd7fdb5340 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:48.762132 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-5bec1dcb-33a2-4038-ba39-b8dd7fdb5340 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:48.815076 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-02918b07-0902-4189-99e7-d9099a2b4ea8 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1728036466", "imageRef": "61912422-61cd-4ced-a573-85ee305e010f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bff04af5-7af0-4830-a1e0-3c54d0cbddac"}], "security_groups": [{"name": "tempest-securitygroup--1296418906"}], "key_name": "tempest-keypair-343976042", "user_data": "}} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:12:49.127092 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-5bec1dcb-33a2-4038-ba39-b8dd7fdb5340 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:49.145086 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-5bec1dcb-33a2-4038-ba39-b8dd7fdb5340 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1222 microversion: 2.1 time: 0.397842 Jul 28 18:12:49.148942 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 12/24] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:12:48 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1222 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:12:49.337427 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ebf2c871-e1fc-4ce7-9574-b8b2216678b4 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:49.338111 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ebf2c871-e1fc-4ce7-9574-b8b2216678b4 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:49.344762 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ebf2c871-e1fc-4ce7-9574-b8b2216678b4 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:49.345254 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ebf2c871-e1fc-4ce7-9574-b8b2216678b4 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:49.346047 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ebf2c871-e1fc-4ce7-9574-b8b2216678b4 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:49.346496 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ebf2c871-e1fc-4ce7-9574-b8b2216678b4 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:49.362369 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.network.neutron [None req-02918b07-0902-4189-99e7-d9099a2b4ea8 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] validate_networks() for [('bff04af5-7af0-4830-a1e0-3c54d0cbddac', None, None, None, None, None)] {{(pid=118454) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 18:12:50.384415 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ebf2c871-e1fc-4ce7-9574-b8b2216678b4 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96e9a9e40c54b6a9a7f8560e4846be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef52881d75f407a942bf960230ea22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:50.401184 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ebf2c871-e1fc-4ce7-9574-b8b2216678b4 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436" status: 200 len: 1314 microversion: 2.1 time: 1.067505 Jul 28 18:12:50.404119 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 13/25] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:12:49 2022] GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 => generated 1314 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:12:50.413669 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b3dbb392-66bf-483c-990e-f6f09d94243f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:50.417337 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b3dbb392-66bf-483c-990e-f6f09d94243f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:50.426336 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b3dbb392-66bf-483c-990e-f6f09d94243f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:50.427362 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b3dbb392-66bf-483c-990e-f6f09d94243f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:50.428376 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b3dbb392-66bf-483c-990e-f6f09d94243f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:50.430599 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b3dbb392-66bf-483c-990e-f6f09d94243f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:50.586046 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b3dbb392-66bf-483c-990e-f6f09d94243f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:50.596903 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b3dbb392-66bf-483c-990e-f6f09d94243f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1226 microversion: 2.1 time: 0.189819 Jul 28 18:12:50.599397 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 14/26] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:12:50 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1226 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:12:51.048102 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.virt.hardware [None req-02918b07-0902-4189-99e7-d9099a2b4ea8 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Flavor limits 0:0:0 {{(pid=118454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 18:12:51.048622 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.virt.hardware [None req-02918b07-0902-4189-99e7-d9099a2b4ea8 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Image limits 0:0:0 {{(pid=118454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 18:12:51.049535 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.virt.hardware [None req-02918b07-0902-4189-99e7-d9099a2b4ea8 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Flavor pref 0:0:0 {{(pid=118454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 18:12:51.050120 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.virt.hardware [None req-02918b07-0902-4189-99e7-d9099a2b4ea8 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Image pref 0:0:0 {{(pid=118454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 18:12:51.050725 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.virt.hardware [None req-02918b07-0902-4189-99e7-d9099a2b4ea8 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 18:12:51.065066 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-02918b07-0902-4189-99e7-d9099a2b4ea8 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:51.070564 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-02918b07-0902-4189-99e7-d9099a2b4ea8 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:51.073555 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-02918b07-0902-4189-99e7-d9099a2b4ea8 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:51.074034 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-02918b07-0902-4189-99e7-d9099a2b4ea8 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:51.091184 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-3c3ec596-66e0-4b09-929c-16e80dacc2f1 req-e0dcc14e-5f04-4fe2-9c92-bfe7f9618dd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b81a4ab-5e71-4dd6-bed5-1a068b1ca436", "tag": "dc5628c1-5dbb-402d-9159-d05b64b9abb0"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:12:51.117772 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-3c3ec596-66e0-4b09-929c-16e80dacc2f1 req-e0dcc14e-5f04-4fe2-9c92-bfe7f9618dd6 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:51.120092 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-3c3ec596-66e0-4b09-929c-16e80dacc2f1 req-e0dcc14e-5f04-4fe2-9c92-bfe7f9618dd6 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:51.121863 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.quota [None req-02918b07-0902-4189-99e7-d9099a2b4ea8 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Getting quotas for project 27b91f25d2be408ba9e8d667a574a7a9. Resources: {'cores', 'ram', 'instances'} {{(pid=118454) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 18:12:51.133229 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.quota [None req-02918b07-0902-4189-99e7-d9099a2b4ea8 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Getting quotas for user b9874df18af245688db1137b6f1b0bff and project 27b91f25d2be408ba9e8d667a574a7a9. Resources: {'cores', 'ram', 'instances'} {{(pid=118454) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 18:12:51.165837 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-02918b07-0902-4189-99e7-d9099a2b4ea8 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Going to run 1 instances... {{(pid=118454) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 18:12:51.174571 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-02918b07-0902-4189-99e7-d9099a2b4ea8 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='61912422-61cd-4ced-a573-85ee305e010f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118454) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 18:12:51.179507 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-3c3ec596-66e0-4b09-929c-16e80dacc2f1 req-e0dcc14e-5f04-4fe2-9c92-bfe7f9618dd6 service nova] Creating event network-changed:dc5628c1-5dbb-402d-9159-d05b64b9abb0 for instance 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 on hv-cinder-84617 Jul 28 18:12:51.182468 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-3c3ec596-66e0-4b09-929c-16e80dacc2f1 req-e0dcc14e-5f04-4fe2-9c92-bfe7f9618dd6 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118453) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 28 18:12:51.186753 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-702d539e-491f-4b61-a6d6-f265aa6de03c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:51.187293 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-702d539e-491f-4b61-a6d6-f265aa6de03c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:51.188113 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-702d539e-491f-4b61-a6d6-f265aa6de03c None None] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:51.188555 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-702d539e-491f-4b61-a6d6-f265aa6de03c None None] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:51.214554 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.compute.rpcapi [None req-702d539e-491f-4b61-a6d6-f265aa6de03c None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 28 18:12:51.215877 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-702d539e-491f-4b61-a6d6-f265aa6de03c None None] Releasing lock "compute-rpcapi-router" {{(pid=118453) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 28 18:12:51.255957 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-702d539e-491f-4b61-a6d6-f265aa6de03c None None] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.328957 Jul 28 18:12:51.260990 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 15/27] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:12:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 18:12:51.283628 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0434844c-b5cc-4b93-8db3-9a4c2ef2094b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-642435517", "imageRef": "61912422-61cd-4ced-a573-85ee305e010f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0082d454-46e3-4fac-a205-e12b0fa3a60d"}], "security_groups": [{"name": "tempest-securitygroup--208084570"}], "key_name": "tempest-keypair-777318939", "user_data": "}} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:12:51.329767 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-02918b07-0902-4189-99e7-d9099a2b4ea8 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.525985 Jul 28 18:12:51.333570 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 13/28] 10.222.0.86 () {60 vars in 1147 bytes} [Thu Jul 28 18:12:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 2532 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 18:12:51.346126 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-7cb587dd-532c-4b80-b517-5e6766a1d945 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:51.348635 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-7cb587dd-532c-4b80-b517-5e6766a1d945 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:51.509460 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-7cb587dd-532c-4b80-b517-5e6766a1d945 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:51.517933 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-7cb587dd-532c-4b80-b517-5e6766a1d945 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1237 microversion: 2.1 time: 0.178241 Jul 28 18:12:51.520440 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 14/29] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:12:51 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1237 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:12:51.537224 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-acdc5874-62f6-4e40-8e24-cab6d15d8306 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:51.537859 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-acdc5874-62f6-4e40-8e24-cab6d15d8306 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:51.557858 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-acdc5874-62f6-4e40-8e24-cab6d15d8306 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:51.558304 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-acdc5874-62f6-4e40-8e24-cab6d15d8306 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:51.559106 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-acdc5874-62f6-4e40-8e24-cab6d15d8306 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:51.559559 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-acdc5874-62f6-4e40-8e24-cab6d15d8306 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:51.755360 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.network.neutron [None req-0434844c-b5cc-4b93-8db3-9a4c2ef2094b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] validate_networks() for [('0082d454-46e3-4fac-a205-e12b0fa3a60d', None, None, None, None, None)] {{(pid=118453) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 18:12:52.245304 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-acdc5874-62f6-4e40-8e24-cab6d15d8306 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96e9a9e40c54b6a9a7f8560e4846be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef52881d75f407a942bf960230ea22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:52.261342 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-acdc5874-62f6-4e40-8e24-cab6d15d8306 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436" status: 200 len: 1314 microversion: 2.1 time: 0.734902 Jul 28 18:12:52.264391 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 15/30] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:12:51 2022] GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 => generated 1314 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:12:52.287201 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-4beb834c-a5df-4479-9d22-6604a73c2544 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:52.310315 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-4beb834c-a5df-4479-9d22-6604a73c2544 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:52.329940 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-4beb834c-a5df-4479-9d22-6604a73c2544 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:52.339368 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-4beb834c-a5df-4479-9d22-6604a73c2544 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:52.342673 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-4beb834c-a5df-4479-9d22-6604a73c2544 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:52.345398 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-4beb834c-a5df-4479-9d22-6604a73c2544 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:52.571319 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-4beb834c-a5df-4479-9d22-6604a73c2544 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:52.586879 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-4beb834c-a5df-4479-9d22-6604a73c2544 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1226 microversion: 2.1 time: 0.312810 Jul 28 18:12:52.594562 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 16/31] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:12:52 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1226 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:12:52.603611 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-fd8f1a16-9d8d-4c46-8e48-65f5e4c97466 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:52.610100 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-fd8f1a16-9d8d-4c46-8e48-65f5e4c97466 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:52.771831 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-fd8f1a16-9d8d-4c46-8e48-65f5e4c97466 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:52.784928 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-fd8f1a16-9d8d-4c46-8e48-65f5e4c97466 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1237 microversion: 2.1 time: 0.188998 Jul 28 18:12:52.786471 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 17/32] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:12:52 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1237 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:12:52.822224 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-0434844c-b5cc-4b93-8db3-9a4c2ef2094b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Flavor limits 0:0:0 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 18:12:52.823480 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-0434844c-b5cc-4b93-8db3-9a4c2ef2094b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Image limits 0:0:0 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 18:12:52.824194 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-0434844c-b5cc-4b93-8db3-9a4c2ef2094b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Flavor pref 0:0:0 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 18:12:52.824785 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-0434844c-b5cc-4b93-8db3-9a4c2ef2094b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Image pref 0:0:0 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 18:12:52.825475 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-0434844c-b5cc-4b93-8db3-9a4c2ef2094b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 18:12:52.853366 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0434844c-b5cc-4b93-8db3-9a4c2ef2094b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:52.854334 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0434844c-b5cc-4b93-8db3-9a4c2ef2094b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:52.855295 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0434844c-b5cc-4b93-8db3-9a4c2ef2094b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:52.855913 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0434844c-b5cc-4b93-8db3-9a4c2ef2094b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:52.876357 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.quota [None req-0434844c-b5cc-4b93-8db3-9a4c2ef2094b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Getting quotas for project 9e962e97777048b79415ba13adcc95be. Resources: {'cores', 'ram', 'instances'} {{(pid=118453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 18:12:52.881720 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.quota [None req-0434844c-b5cc-4b93-8db3-9a4c2ef2094b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Getting quotas for user ca7d773290a9483d91ebefad341addee and project 9e962e97777048b79415ba13adcc95be. Resources: {'cores', 'ram', 'instances'} {{(pid=118453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 18:12:52.900562 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0434844c-b5cc-4b93-8db3-9a4c2ef2094b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Going to run 1 instances... {{(pid=118453) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 18:12:52.900562 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0434844c-b5cc-4b93-8db3-9a4c2ef2094b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='61912422-61cd-4ced-a573-85ee305e010f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 18:12:53.114817 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0434844c-b5cc-4b93-8db3-9a4c2ef2094b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.842335 Jul 28 18:12:53.115742 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 16/33] 10.222.0.86 () {62 vars in 1188 bytes} [Thu Jul 28 18:12:51 2022] POST /compute/v2.1/servers => generated 401 bytes in 1844 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 28 18:12:53.126762 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-f22785e4-eb6d-459d-8403-cf744e55e9ad tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:53.127380 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-f22785e4-eb6d-459d-8403-cf744e55e9ad tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:53.225350 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-f22785e4-eb6d-459d-8403-cf744e55e9ad tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:53.242317 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-f22785e4-eb6d-459d-8403-cf744e55e9ad tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:53.244288 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-f22785e4-eb6d-459d-8403-cf744e55e9ad tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:53.245575 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-f22785e4-eb6d-459d-8403-cf744e55e9ad tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1280 microversion: 2.20 time: 0.122826 Jul 28 18:12:53.257093 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 18/34] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:12:53 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1280 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:12:53.284394 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-7e66735f-a8cb-4cf2-8641-bb8d02098257 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:53.285152 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-7e66735f-a8cb-4cf2-8641-bb8d02098257 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:53.308191 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7e66735f-a8cb-4cf2-8641-bb8d02098257 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:53.308191 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7e66735f-a8cb-4cf2-8641-bb8d02098257 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:53.308191 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7e66735f-a8cb-4cf2-8641-bb8d02098257 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:53.308191 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7e66735f-a8cb-4cf2-8641-bb8d02098257 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:53.549290 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-7e66735f-a8cb-4cf2-8641-bb8d02098257 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96e9a9e40c54b6a9a7f8560e4846be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef52881d75f407a942bf960230ea22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:53.558505 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-7e66735f-a8cb-4cf2-8641-bb8d02098257 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436" status: 200 len: 1314 microversion: 2.1 time: 0.278506 Jul 28 18:12:53.572665 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 17/35] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:12:53 2022] GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:12:53.623662 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-63709a6d-d08c-45fe-b6c1-346ca4de5782 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:53.629616 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-63709a6d-d08c-45fe-b6c1-346ca4de5782 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:53.647160 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-63709a6d-d08c-45fe-b6c1-346ca4de5782 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:53.647616 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-63709a6d-d08c-45fe-b6c1-346ca4de5782 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:53.648419 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-63709a6d-d08c-45fe-b6c1-346ca4de5782 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:53.648867 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-63709a6d-d08c-45fe-b6c1-346ca4de5782 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:53.815098 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-63709a6d-d08c-45fe-b6c1-346ca4de5782 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:53.817661 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-49ad16af-3386-4550-8a92-8c2986f288b6 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:53.818448 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-49ad16af-3386-4550-8a92-8c2986f288b6 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:53.842009 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-63709a6d-d08c-45fe-b6c1-346ca4de5782 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1226 microversion: 2.1 time: 0.232245 Jul 28 18:12:53.843787 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 19/36] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:12:53 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1226 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:12:53.861858 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-49ad16af-3386-4550-8a92-8c2986f288b6 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:53.862437 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-49ad16af-3386-4550-8a92-8c2986f288b6 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:53.865797 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-49ad16af-3386-4550-8a92-8c2986f288b6 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:53.866515 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-49ad16af-3386-4550-8a92-8c2986f288b6 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:54.107726 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-49ad16af-3386-4550-8a92-8c2986f288b6 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:54.118654 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-49ad16af-3386-4550-8a92-8c2986f288b6 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1241 microversion: 2.1 time: 0.310363 Jul 28 18:12:54.121796 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 18/37] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:12:53 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1241 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:12:54.282288 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-caeebe12-c558-4083-aa82-a52dccea461b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:54.297184 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-caeebe12-c558-4083-aa82-a52dccea461b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:54.561013 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-caeebe12-c558-4083-aa82-a52dccea461b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:54.569290 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-caeebe12-c558-4083-aa82-a52dccea461b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:54.570834 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-caeebe12-c558-4083-aa82-a52dccea461b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:54.580790 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3d99e9c5-a093-47a7-a24f-c88a6970c473 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:54.581454 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3d99e9c5-a093-47a7-a24f-c88a6970c473 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:54.600862 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3d99e9c5-a093-47a7-a24f-c88a6970c473 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:54.601354 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3d99e9c5-a093-47a7-a24f-c88a6970c473 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:54.602149 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3d99e9c5-a093-47a7-a24f-c88a6970c473 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:54.602594 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3d99e9c5-a093-47a7-a24f-c88a6970c473 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:54.607230 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-caeebe12-c558-4083-aa82-a52dccea461b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1280 microversion: 2.20 time: 0.338667 Jul 28 18:12:54.634201 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 20/38] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:12:54 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1280 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:12:54.871391 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-37866b22-c9ef-42a8-89a6-cf7ec22dac19 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:54.874715 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-37866b22-c9ef-42a8-89a6-cf7ec22dac19 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:54.896040 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-37866b22-c9ef-42a8-89a6-cf7ec22dac19 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:54.928956 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-37866b22-c9ef-42a8-89a6-cf7ec22dac19 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:54.930827 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-37866b22-c9ef-42a8-89a6-cf7ec22dac19 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:54.931651 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-37866b22-c9ef-42a8-89a6-cf7ec22dac19 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:55.204355 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-37866b22-c9ef-42a8-89a6-cf7ec22dac19 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:55.244319 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-37866b22-c9ef-42a8-89a6-cf7ec22dac19 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1218 microversion: 2.1 time: 0.384780 Jul 28 18:12:55.245211 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 21/39] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:12:54 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1218 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:12:55.261594 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-6f0446fd-97a1-4be5-992d-07be900802d1 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:55.262219 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-6f0446fd-97a1-4be5-992d-07be900802d1 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:55.274258 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-6f0446fd-97a1-4be5-992d-07be900802d1 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:55.283184 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-6f0446fd-97a1-4be5-992d-07be900802d1 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:55.283184 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-6f0446fd-97a1-4be5-992d-07be900802d1 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:55.284244 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-6f0446fd-97a1-4be5-992d-07be900802d1 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:55.431895 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-6f0446fd-97a1-4be5-992d-07be900802d1 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:55.440930 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-6f0446fd-97a1-4be5-992d-07be900802d1 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1289 microversion: 2.1 time: 0.194363 Jul 28 18:12:55.445670 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 22/40] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:12:55 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1289 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:12:55.530551 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-3d99e9c5-a093-47a7-a24f-c88a6970c473 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96e9a9e40c54b6a9a7f8560e4846be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef52881d75f407a942bf960230ea22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:55.537233 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-3d99e9c5-a093-47a7-a24f-c88a6970c473 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436" status: 200 len: 1314 microversion: 2.1 time: 0.960320 Jul 28 18:12:55.537873 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 19/41] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:12:54 2022] GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 => generated 1314 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:12:55.639677 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-f1699381-f2ac-447b-8540-d3b7c7fc6f8f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:55.640415 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-f1699381-f2ac-447b-8540-d3b7c7fc6f8f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:55.657097 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f1699381-f2ac-447b-8540-d3b7c7fc6f8f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:55.657754 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f1699381-f2ac-447b-8540-d3b7c7fc6f8f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:55.658779 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f1699381-f2ac-447b-8540-d3b7c7fc6f8f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:55.659370 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f1699381-f2ac-447b-8540-d3b7c7fc6f8f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:55.803587 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-f1699381-f2ac-447b-8540-d3b7c7fc6f8f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:55.819623 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-f1699381-f2ac-447b-8540-d3b7c7fc6f8f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:55.827389 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-f1699381-f2ac-447b-8540-d3b7c7fc6f8f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:55.828953 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-f1699381-f2ac-447b-8540-d3b7c7fc6f8f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1284 microversion: 2.20 time: 0.193167 Jul 28 18:12:55.830289 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 23/42] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:12:55 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1284 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:12:56.271984 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ab903315-c413-44e4-8496-63aab4a9786d tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:56.277754 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ab903315-c413-44e4-8496-63aab4a9786d tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:56.300858 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ab903315-c413-44e4-8496-63aab4a9786d tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:56.305472 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ab903315-c413-44e4-8496-63aab4a9786d tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:56.309269 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ab903315-c413-44e4-8496-63aab4a9786d tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:56.316215 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ab903315-c413-44e4-8496-63aab4a9786d tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:56.474862 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-b715dee1-0ab0-4ac6-950d-11d0a00f4877 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:56.476720 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-b715dee1-0ab0-4ac6-950d-11d0a00f4877 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:56.495851 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b715dee1-0ab0-4ac6-950d-11d0a00f4877 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:56.498755 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b715dee1-0ab0-4ac6-950d-11d0a00f4877 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:56.508587 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b715dee1-0ab0-4ac6-950d-11d0a00f4877 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:56.516221 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b715dee1-0ab0-4ac6-950d-11d0a00f4877 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:56.623946 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ab903315-c413-44e4-8496-63aab4a9786d tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:56.634315 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ab903315-c413-44e4-8496-63aab4a9786d tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1274 microversion: 2.1 time: 0.367166 Jul 28 18:12:56.638044 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 20/43] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:12:56 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1274 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:12:56.653116 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f2c0c0ae-2f4f-4e08-938a-9b4e23b68a13 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:56.653758 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f2c0c0ae-2f4f-4e08-938a-9b4e23b68a13 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:56.699805 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f2c0c0ae-2f4f-4e08-938a-9b4e23b68a13 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:56.700269 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f2c0c0ae-2f4f-4e08-938a-9b4e23b68a13 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:56.706177 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f2c0c0ae-2f4f-4e08-938a-9b4e23b68a13 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:56.706787 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f2c0c0ae-2f4f-4e08-938a-9b4e23b68a13 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:57.379128 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-b715dee1-0ab0-4ac6-950d-11d0a00f4877 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:57.409114 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-b715dee1-0ab0-4ac6-950d-11d0a00f4877 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1289 microversion: 2.1 time: 0.938766 Jul 28 18:12:57.421545 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 24/44] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:12:56 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1289 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:12:57.449246 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-b866128e-4030-4d73-8b59-e730ad7dfb16 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:57.450082 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-b866128e-4030-4d73-8b59-e730ad7dfb16 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:57.458423 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b866128e-4030-4d73-8b59-e730ad7dfb16 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:57.464342 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b866128e-4030-4d73-8b59-e730ad7dfb16 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:57.465626 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b866128e-4030-4d73-8b59-e730ad7dfb16 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:57.468537 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b866128e-4030-4d73-8b59-e730ad7dfb16 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:57.555501 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f2c0c0ae-2f4f-4e08-938a-9b4e23b68a13 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96e9a9e40c54b6a9a7f8560e4846be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef52881d75f407a942bf960230ea22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:57.564105 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f2c0c0ae-2f4f-4e08-938a-9b4e23b68a13 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436" status: 200 len: 1314 microversion: 2.1 time: 0.924730 Jul 28 18:12:57.564714 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 21/45] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:12:56 2022] GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 => generated 1314 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:12:57.669467 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-309736b5-d3c1-43d0-8f39-602c03c82fda tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:57.678843 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-309736b5-d3c1-43d0-8f39-602c03c82fda tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:57.688826 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-309736b5-d3c1-43d0-8f39-602c03c82fda tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:57.691516 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-309736b5-d3c1-43d0-8f39-602c03c82fda tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:57.694359 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-b866128e-4030-4d73-8b59-e730ad7dfb16 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:57.694856 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-309736b5-d3c1-43d0-8f39-602c03c82fda tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:57.695661 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-309736b5-d3c1-43d0-8f39-602c03c82fda tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:57.706879 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-b866128e-4030-4d73-8b59-e730ad7dfb16 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:57.718832 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-b866128e-4030-4d73-8b59-e730ad7dfb16 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:57.718832 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-b866128e-4030-4d73-8b59-e730ad7dfb16 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1276 microversion: 2.20 time: 0.295676 Jul 28 18:12:57.743649 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 25/46] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:12:57 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1276 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:12:58.040216 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-309736b5-d3c1-43d0-8f39-602c03c82fda tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:58.064559 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-309736b5-d3c1-43d0-8f39-602c03c82fda tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1274 microversion: 2.1 time: 0.405725 Jul 28 18:12:58.065675 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 22/47] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:12:57 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1274 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:12:58.434470 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-3ab1f49b-8aad-4409-a6a2-b20fbc7c6aa2 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:58.435887 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-3ab1f49b-8aad-4409-a6a2-b20fbc7c6aa2 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:58.448606 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-3ab1f49b-8aad-4409-a6a2-b20fbc7c6aa2 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:58.449339 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-3ab1f49b-8aad-4409-a6a2-b20fbc7c6aa2 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:58.451986 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-3ab1f49b-8aad-4409-a6a2-b20fbc7c6aa2 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:58.458060 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-3ab1f49b-8aad-4409-a6a2-b20fbc7c6aa2 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:58.589672 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0486fa23-aca6-473c-ac67-15d466e8e8f7 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:58.590708 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0486fa23-aca6-473c-ac67-15d466e8e8f7 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:58.598059 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0486fa23-aca6-473c-ac67-15d466e8e8f7 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:58.612870 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0486fa23-aca6-473c-ac67-15d466e8e8f7 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:58.619376 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0486fa23-aca6-473c-ac67-15d466e8e8f7 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:58.619985 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0486fa23-aca6-473c-ac67-15d466e8e8f7 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:59.009654 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-3ab1f49b-8aad-4409-a6a2-b20fbc7c6aa2 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:59.023727 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-3ab1f49b-8aad-4409-a6a2-b20fbc7c6aa2 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1307 microversion: 2.1 time: 0.593370 Jul 28 18:12:59.026821 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 26/48] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:12:58 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1307 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:12:59.053556 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-4b05086c-a757-444a-9bb0-c91188acd0f5 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:59.054576 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-4b05086c-a757-444a-9bb0-c91188acd0f5 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:59.075151 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:12:59.097489 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-4b05086c-a757-444a-9bb0-c91188acd0f5 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:59.098399 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-4b05086c-a757-444a-9bb0-c91188acd0f5 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:59.099567 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-4b05086c-a757-444a-9bb0-c91188acd0f5 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:59.102304 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-4b05086c-a757-444a-9bb0-c91188acd0f5 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:59.592664 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-4b05086c-a757-444a-9bb0-c91188acd0f5 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:59.610011 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-4b05086c-a757-444a-9bb0-c91188acd0f5 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:59.612175 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-4b05086c-a757-444a-9bb0-c91188acd0f5 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:59.613915 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-4b05086c-a757-444a-9bb0-c91188acd0f5 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1332 microversion: 2.20 time: 0.569675 Jul 28 18:12:59.625769 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 27/49] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:12:59 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1332 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:12:59.632197 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-12f70d2d-e963-4a1d-803c-db6921181c46 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:59.633015 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-12f70d2d-e963-4a1d-803c-db6921181c46 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:59.649282 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-12f70d2d-e963-4a1d-803c-db6921181c46 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:59.650552 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-12f70d2d-e963-4a1d-803c-db6921181c46 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:59.651747 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-12f70d2d-e963-4a1d-803c-db6921181c46 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:59.652338 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-12f70d2d-e963-4a1d-803c-db6921181c46 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:59.888214 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-12f70d2d-e963-4a1d-803c-db6921181c46 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:59.900410 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-12f70d2d-e963-4a1d-803c-db6921181c46 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1280 microversion: 2.1 time: 0.273336 Jul 28 18:12:59.902039 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 28/50] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:12:59 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1280 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:12:59.949532 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-0486fa23-aca6-473c-ac67-15d466e8e8f7 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96e9a9e40c54b6a9a7f8560e4846be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef52881d75f407a942bf960230ea22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:59.952635 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=87 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:12:59.970357 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0486fa23-aca6-473c-ac67-15d466e8e8f7 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436" status: 200 len: 1314 microversion: 2.1 time: 1.384182 Jul 28 18:12:59.991867 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 23/51] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:12:58 2022] GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 => generated 1314 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:13:00.052252 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-556d94a2-83a9-46ad-b0f2-9ae8066d3574 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:00.052872 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-556d94a2-83a9-46ad-b0f2-9ae8066d3574 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:00.075351 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-556d94a2-83a9-46ad-b0f2-9ae8066d3574 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:00.076336 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-556d94a2-83a9-46ad-b0f2-9ae8066d3574 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:00.079936 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-556d94a2-83a9-46ad-b0f2-9ae8066d3574 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:00.081669 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-556d94a2-83a9-46ad-b0f2-9ae8066d3574 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:00.273816 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-556d94a2-83a9-46ad-b0f2-9ae8066d3574 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:00.301250 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-556d94a2-83a9-46ad-b0f2-9ae8066d3574 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1295 microversion: 2.1 time: 0.254925 Jul 28 18:13:00.308253 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 29/52] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:00 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1295 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:00.654794 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0f2fe50a-227f-4ea5-8f5b-eff40e87d3c2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:00.655438 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0f2fe50a-227f-4ea5-8f5b-eff40e87d3c2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:00.657500 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=10 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:13:00.671908 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0f2fe50a-227f-4ea5-8f5b-eff40e87d3c2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:00.672760 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0f2fe50a-227f-4ea5-8f5b-eff40e87d3c2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:00.679835 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0f2fe50a-227f-4ea5-8f5b-eff40e87d3c2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:00.679835 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0f2fe50a-227f-4ea5-8f5b-eff40e87d3c2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:00.875909 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-0f2fe50a-227f-4ea5-8f5b-eff40e87d3c2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:00.890079 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-0f2fe50a-227f-4ea5-8f5b-eff40e87d3c2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:00.893755 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-0f2fe50a-227f-4ea5-8f5b-eff40e87d3c2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:00.894922 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0f2fe50a-227f-4ea5-8f5b-eff40e87d3c2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1338 microversion: 2.20 time: 0.246019 Jul 28 18:13:00.895497 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 24/53] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:13:00 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1338 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:13:00.926152 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-c56c7353-045f-4d84-93c1-9277106508e3 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:00.927279 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-c56c7353-045f-4d84-93c1-9277106508e3 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:00.955824 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c56c7353-045f-4d84-93c1-9277106508e3 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:00.964432 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c56c7353-045f-4d84-93c1-9277106508e3 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:00.964432 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c56c7353-045f-4d84-93c1-9277106508e3 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:00.964432 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c56c7353-045f-4d84-93c1-9277106508e3 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:00.999994 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-bd387a54-85d5-4f86-894e-5ea591f3a20e tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:01.001452 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-bd387a54-85d5-4f86-894e-5ea591f3a20e tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:01.014426 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bd387a54-85d5-4f86-894e-5ea591f3a20e tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:01.015072 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bd387a54-85d5-4f86-894e-5ea591f3a20e tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:01.019459 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bd387a54-85d5-4f86-894e-5ea591f3a20e tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:01.019459 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bd387a54-85d5-4f86-894e-5ea591f3a20e tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:01.068679 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-c56c7353-045f-4d84-93c1-9277106508e3 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:01.072133 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell1:SELECT=100 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:13:01.080878 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-c56c7353-045f-4d84-93c1-9277106508e3 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1280 microversion: 2.1 time: 0.159372 Jul 28 18:13:01.093169 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 30/54] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:00 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1280 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:01.338049 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-3f286c91-7b1a-491b-8110-53ccef1fb5eb tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:01.347755 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-3f286c91-7b1a-491b-8110-53ccef1fb5eb tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:01.347755 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell0:SELECT=4 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:13:01.350109 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-3f286c91-7b1a-491b-8110-53ccef1fb5eb tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:01.352327 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-3f286c91-7b1a-491b-8110-53ccef1fb5eb tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:01.354480 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-3f286c91-7b1a-491b-8110-53ccef1fb5eb tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:01.355386 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-3f286c91-7b1a-491b-8110-53ccef1fb5eb tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:01.718212 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-3f286c91-7b1a-491b-8110-53ccef1fb5eb tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:01.731968 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-3f286c91-7b1a-491b-8110-53ccef1fb5eb tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1295 microversion: 2.1 time: 0.401179 Jul 28 18:13:01.732796 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 31/55] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:01 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1295 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:13:01.862521 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-bd387a54-85d5-4f86-894e-5ea591f3a20e tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96e9a9e40c54b6a9a7f8560e4846be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef52881d75f407a942bf960230ea22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:01.862521 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-bd387a54-85d5-4f86-894e-5ea591f3a20e tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436" status: 200 len: 1314 microversion: 2.1 time: 0.823305 Jul 28 18:13:01.862521 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 25/56] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:00 2022] GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 => generated 1314 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:13:01.920111 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-07dd6254-5184-44ad-8efa-ababd4b21a5b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:01.920807 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-07dd6254-5184-44ad-8efa-ababd4b21a5b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:01.926970 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-07dd6254-5184-44ad-8efa-ababd4b21a5b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:01.927424 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-07dd6254-5184-44ad-8efa-ababd4b21a5b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:01.928328 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-07dd6254-5184-44ad-8efa-ababd4b21a5b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:01.928777 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-07dd6254-5184-44ad-8efa-ababd4b21a5b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:02.038480 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-07dd6254-5184-44ad-8efa-ababd4b21a5b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:02.051129 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-07dd6254-5184-44ad-8efa-ababd4b21a5b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:02.052747 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-07dd6254-5184-44ad-8efa-ababd4b21a5b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:02.054253 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-07dd6254-5184-44ad-8efa-ababd4b21a5b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1338 microversion: 2.20 time: 0.138140 Jul 28 18:13:02.055155 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 32/57] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:13:01 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1338 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:13:02.106242 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-18fd2fd4-9ad2-4554-af87-5e3b0c907d44 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:02.106831 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-18fd2fd4-9ad2-4554-af87-5e3b0c907d44 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:02.112752 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-18fd2fd4-9ad2-4554-af87-5e3b0c907d44 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:02.113196 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-18fd2fd4-9ad2-4554-af87-5e3b0c907d44 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:02.113956 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-18fd2fd4-9ad2-4554-af87-5e3b0c907d44 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:02.114398 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-18fd2fd4-9ad2-4554-af87-5e3b0c907d44 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:02.179625 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-18fd2fd4-9ad2-4554-af87-5e3b0c907d44 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:02.187949 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-18fd2fd4-9ad2-4554-af87-5e3b0c907d44 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1280 microversion: 2.1 time: 0.085538 Jul 28 18:13:02.188623 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 26/58] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:02 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1280 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:02.756498 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-99fa6984-e99f-44db-98ca-f4a0ad74b577 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:02.756498 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-99fa6984-e99f-44db-98ca-f4a0ad74b577 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:02.765149 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-99fa6984-e99f-44db-98ca-f4a0ad74b577 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:02.765514 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-99fa6984-e99f-44db-98ca-f4a0ad74b577 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:02.780324 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-99fa6984-e99f-44db-98ca-f4a0ad74b577 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:02.781053 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-99fa6984-e99f-44db-98ca-f4a0ad74b577 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:02.881373 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-054fb4f2-7958-4836-89e8-5acc917be573 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:02.881989 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-054fb4f2-7958-4836-89e8-5acc917be573 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:02.883844 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell0:SELECT=6 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:13:02.893823 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell0:SELECT=26 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:13:02.904585 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-054fb4f2-7958-4836-89e8-5acc917be573 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:02.909975 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-054fb4f2-7958-4836-89e8-5acc917be573 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:02.909975 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-054fb4f2-7958-4836-89e8-5acc917be573 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:02.909975 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-054fb4f2-7958-4836-89e8-5acc917be573 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:03.196535 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-054fb4f2-7958-4836-89e8-5acc917be573 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96e9a9e40c54b6a9a7f8560e4846be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef52881d75f407a942bf960230ea22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:03.209925 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-054fb4f2-7958-4836-89e8-5acc917be573 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436" status: 200 len: 1314 microversion: 2.1 time: 0.332233 Jul 28 18:13:03.214507 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 27/59] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:02 2022] GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 => generated 1314 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:13:03.230576 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-99fa6984-e99f-44db-98ca-f4a0ad74b577 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:03.237437 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a75637f5-1948-4a86-a9a3-50839cb44e6f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:03.240614 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-99fa6984-e99f-44db-98ca-f4a0ad74b577 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1363 microversion: 2.1 time: 0.490485 Jul 28 18:13:03.241101 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-a75637f5-1948-4a86-a9a3-50839cb44e6f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:03.242254 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 33/60] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:02 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1363 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:03.247034 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-fa67b017-5bc3-4880-967e-d288e16b01a6 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:03.248472 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-fa67b017-5bc3-4880-967e-d288e16b01a6 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:03.254659 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-fa67b017-5bc3-4880-967e-d288e16b01a6 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:03.264397 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-fa67b017-5bc3-4880-967e-d288e16b01a6 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:03.269526 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-fa67b017-5bc3-4880-967e-d288e16b01a6 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:03.269526 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-fa67b017-5bc3-4880-967e-d288e16b01a6 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:03.271066 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a75637f5-1948-4a86-a9a3-50839cb44e6f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:03.275803 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a75637f5-1948-4a86-a9a3-50839cb44e6f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:03.276796 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a75637f5-1948-4a86-a9a3-50839cb44e6f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:03.279767 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a75637f5-1948-4a86-a9a3-50839cb44e6f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:03.569644 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-fa67b017-5bc3-4880-967e-d288e16b01a6 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:03.577885 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-fa67b017-5bc3-4880-967e-d288e16b01a6 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1322 microversion: 2.1 time: 0.334412 Jul 28 18:13:03.593136 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 34/61] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:03 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1322 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:03.707356 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-a75637f5-1948-4a86-a9a3-50839cb44e6f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:03.724145 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-a75637f5-1948-4a86-a9a3-50839cb44e6f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:03.738079 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-a75637f5-1948-4a86-a9a3-50839cb44e6f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:03.738079 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-a75637f5-1948-4a86-a9a3-50839cb44e6f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1405 microversion: 2.20 time: 0.517705 Jul 28 18:13:03.738079 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 28/62] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:13:03 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1405 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:13:04.239414 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-200bca2c-ed08-466c-8261-77310425794d tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:04.240598 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-200bca2c-ed08-466c-8261-77310425794d tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:04.250203 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-200bca2c-ed08-466c-8261-77310425794d tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:04.250842 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-200bca2c-ed08-466c-8261-77310425794d tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:04.252223 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-200bca2c-ed08-466c-8261-77310425794d tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:04.252790 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-200bca2c-ed08-466c-8261-77310425794d tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:04.263672 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ac805703-13e0-4c30-9a8d-5fad0c635e07 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:04.265863 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ac805703-13e0-4c30-9a8d-5fad0c635e07 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:04.283440 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ac805703-13e0-4c30-9a8d-5fad0c635e07 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:04.284210 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ac805703-13e0-4c30-9a8d-5fad0c635e07 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:04.287475 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ac805703-13e0-4c30-9a8d-5fad0c635e07 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:04.288082 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ac805703-13e0-4c30-9a8d-5fad0c635e07 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:04.568584 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell0:SELECT=30 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:13:04.718996 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-200bca2c-ed08-466c-8261-77310425794d tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96e9a9e40c54b6a9a7f8560e4846be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef52881d75f407a942bf960230ea22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:04.739535 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-200bca2c-ed08-466c-8261-77310425794d tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436" status: 200 len: 1314 microversion: 2.1 time: 0.508083 Jul 28 18:13:04.753479 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 35/63] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:04 2022] GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 => generated 1314 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:04.805875 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ac805703-13e0-4c30-9a8d-5fad0c635e07 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:04.819586 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ac805703-13e0-4c30-9a8d-5fad0c635e07 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1363 microversion: 2.1 time: 0.559577 Jul 28 18:13:04.819586 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 29/64] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:04 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1363 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:04.829895 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3c60ebe8-6b40-455a-9db1-114287391350 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:04.830507 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3c60ebe8-6b40-455a-9db1-114287391350 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:04.838958 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3c60ebe8-6b40-455a-9db1-114287391350 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:04.839721 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3c60ebe8-6b40-455a-9db1-114287391350 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:04.841311 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3c60ebe8-6b40-455a-9db1-114287391350 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:04.842415 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3c60ebe8-6b40-455a-9db1-114287391350 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:05.153680 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [req-f9342095-782d-4dc9-8c89-85da89f77c45 req-331230a2-0e41-476a-a42a-871dd2f0912e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1", "tag": "f42a05fc-306d-49b7-863f-7888a1c5f431"}]} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:13:05.187547 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-f9342095-782d-4dc9-8c89-85da89f77c45 req-331230a2-0e41-476a-a42a-871dd2f0912e service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:05.188740 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-f9342095-782d-4dc9-8c89-85da89f77c45 req-331230a2-0e41-476a-a42a-871dd2f0912e service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:05.235738 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.compute.server_external_events [req-f9342095-782d-4dc9-8c89-85da89f77c45 req-331230a2-0e41-476a-a42a-871dd2f0912e service nova] Creating event network-changed:f42a05fc-306d-49b7-863f-7888a1c5f431 for instance 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 on hv-cinder-84617 Jul 28 18:13:05.242066 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-f9342095-782d-4dc9-8c89-85da89f77c45 req-331230a2-0e41-476a-a42a-871dd2f0912e service nova] Acquired lock "compute-rpcapi-router" {{(pid=118454) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 28 18:13:05.244350 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a93302e6-a468-4b56-8603-b63c969733a8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:05.244957 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a93302e6-a468-4b56-8603-b63c969733a8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:05.245937 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a93302e6-a468-4b56-8603-b63c969733a8 None None] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:05.246526 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a93302e6-a468-4b56-8603-b63c969733a8 None None] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:05.269998 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.compute.rpcapi [None req-a93302e6-a468-4b56-8603-b63c969733a8 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 28 18:13:05.271083 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a93302e6-a468-4b56-8603-b63c969733a8 None None] Releasing lock "compute-rpcapi-router" {{(pid=118454) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 28 18:13:05.295176 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-a93302e6-a468-4b56-8603-b63c969733a8 None None] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.540100 Jul 28 18:13:05.297942 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 36/65] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:13:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:13:05.312847 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-8b9fca3d-251b-47db-a463-5b2e3752d0be tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:05.315474 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-8b9fca3d-251b-47db-a463-5b2e3752d0be tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:05.332180 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-8b9fca3d-251b-47db-a463-5b2e3752d0be tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:05.334896 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-8b9fca3d-251b-47db-a463-5b2e3752d0be tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:05.337696 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-8b9fca3d-251b-47db-a463-5b2e3752d0be tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:05.339857 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-8b9fca3d-251b-47db-a463-5b2e3752d0be tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:05.439207 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-3c60ebe8-6b40-455a-9db1-114287391350 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:05.468919 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-3c60ebe8-6b40-455a-9db1-114287391350 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1322 microversion: 2.1 time: 0.646691 Jul 28 18:13:05.476958 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 30/66] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:04 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1322 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:05.713230 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-8b9fca3d-251b-47db-a463-5b2e3752d0be tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:05.727026 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-8b9fca3d-251b-47db-a463-5b2e3752d0be tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:05.728844 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-8b9fca3d-251b-47db-a463-5b2e3752d0be tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:05.730168 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-8b9fca3d-251b-47db-a463-5b2e3752d0be tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1405 microversion: 2.20 time: 0.429599 Jul 28 18:13:05.730955 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 37/67] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:13:05 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1405 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:13:05.759795 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-8645f80b-48d2-4a75-8e43-99bfec1a1f9b tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:05.760421 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-8645f80b-48d2-4a75-8e43-99bfec1a1f9b tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:05.768030 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8645f80b-48d2-4a75-8e43-99bfec1a1f9b tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:05.768476 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8645f80b-48d2-4a75-8e43-99bfec1a1f9b tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:05.769303 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8645f80b-48d2-4a75-8e43-99bfec1a1f9b tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:05.769750 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8645f80b-48d2-4a75-8e43-99bfec1a1f9b tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:05.840213 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-a7de5f01-fe9b-4031-be9c-0e40f192bf85 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:05.844747 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-a7de5f01-fe9b-4031-be9c-0e40f192bf85 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:05.848375 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a7de5f01-fe9b-4031-be9c-0e40f192bf85 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:05.848835 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a7de5f01-fe9b-4031-be9c-0e40f192bf85 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:05.849656 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a7de5f01-fe9b-4031-be9c-0e40f192bf85 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:05.850082 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a7de5f01-fe9b-4031-be9c-0e40f192bf85 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:06.254868 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8645f80b-48d2-4a75-8e43-99bfec1a1f9b tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96e9a9e40c54b6a9a7f8560e4846be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef52881d75f407a942bf960230ea22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:06.271666 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-8645f80b-48d2-4a75-8e43-99bfec1a1f9b tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436" status: 200 len: 1314 microversion: 2.1 time: 0.515654 Jul 28 18:13:06.277798 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 31/68] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:05 2022] GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 => generated 1314 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:06.282183 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-a7de5f01-fe9b-4031-be9c-0e40f192bf85 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:06.287014 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-f37f1e7d-9d1c-491a-8200-797cc4466e7f req-e0eaf74d-5f77-43d0-bc58-35571c11256d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75328faf-ff9c-4e13-9643-bb73b0079a5a", "tag": "ae8cbb70-b373-4a44-b403-9f6ac40dbbca"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:13:06.296616 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-a7de5f01-fe9b-4031-be9c-0e40f192bf85 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1363 microversion: 2.1 time: 0.460595 Jul 28 18:13:06.301166 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 38/69] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:05 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1363 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:13:06.314555 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-f37f1e7d-9d1c-491a-8200-797cc4466e7f req-e0eaf74d-5f77-43d0-bc58-35571c11256d service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:06.315254 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-f37f1e7d-9d1c-491a-8200-797cc4466e7f req-e0eaf74d-5f77-43d0-bc58-35571c11256d service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:06.334857 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-f37f1e7d-9d1c-491a-8200-797cc4466e7f req-e0eaf74d-5f77-43d0-bc58-35571c11256d service nova] Creating event network-changed:ae8cbb70-b373-4a44-b403-9f6ac40dbbca for instance 75328faf-ff9c-4e13-9643-bb73b0079a5a on hv-cinder-84617 Jul 28 18:13:06.340688 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-f37f1e7d-9d1c-491a-8200-797cc4466e7f req-e0eaf74d-5f77-43d0-bc58-35571c11256d service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058390 Jul 28 18:13:06.346099 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 32/70] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:13:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:13:06.494613 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-c4248051-882b-43f7-b3cd-d402c2dab665 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:06.495671 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-c4248051-882b-43f7-b3cd-d402c2dab665 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:06.501841 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c4248051-882b-43f7-b3cd-d402c2dab665 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:06.506577 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c4248051-882b-43f7-b3cd-d402c2dab665 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:06.506577 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c4248051-882b-43f7-b3cd-d402c2dab665 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:06.506577 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c4248051-882b-43f7-b3cd-d402c2dab665 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:06.651782 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-c4248051-882b-43f7-b3cd-d402c2dab665 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:06.659993 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-c4248051-882b-43f7-b3cd-d402c2dab665 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1322 microversion: 2.1 time: 0.169390 Jul 28 18:13:06.660563 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 39/71] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:06 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:06.754045 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-c3eec2f0-aeab-4111-81c5-11b1196df5b6 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:06.754752 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-c3eec2f0-aeab-4111-81c5-11b1196df5b6 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:06.765127 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c3eec2f0-aeab-4111-81c5-11b1196df5b6 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:06.765860 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c3eec2f0-aeab-4111-81c5-11b1196df5b6 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:06.766801 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c3eec2f0-aeab-4111-81c5-11b1196df5b6 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:06.767491 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c3eec2f0-aeab-4111-81c5-11b1196df5b6 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:06.971770 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-c3eec2f0-aeab-4111-81c5-11b1196df5b6 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:06.979928 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-c3eec2f0-aeab-4111-81c5-11b1196df5b6 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:06.981459 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-c3eec2f0-aeab-4111-81c5-11b1196df5b6 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:06.982603 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-c3eec2f0-aeab-4111-81c5-11b1196df5b6 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1405 microversion: 2.20 time: 0.234089 Jul 28 18:13:06.983165 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 33/72] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:13:06 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1405 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:13:07.303800 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-d21429b9-f1d7-486f-b80d-180a70ebe312 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:07.303800 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-d21429b9-f1d7-486f-b80d-180a70ebe312 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:07.317115 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d21429b9-f1d7-486f-b80d-180a70ebe312 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:07.318280 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d21429b9-f1d7-486f-b80d-180a70ebe312 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:07.323562 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-2cbf5ae3-4b48-4b8c-a096-57241c67f5d2 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:07.324114 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-2cbf5ae3-4b48-4b8c-a096-57241c67f5d2 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:07.324487 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d21429b9-f1d7-486f-b80d-180a70ebe312 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:07.325278 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d21429b9-f1d7-486f-b80d-180a70ebe312 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:07.336023 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2cbf5ae3-4b48-4b8c-a096-57241c67f5d2 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:07.336917 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2cbf5ae3-4b48-4b8c-a096-57241c67f5d2 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:07.337889 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2cbf5ae3-4b48-4b8c-a096-57241c67f5d2 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:07.339488 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2cbf5ae3-4b48-4b8c-a096-57241c67f5d2 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:08.034363 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-2cbf5ae3-4b48-4b8c-a096-57241c67f5d2 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:08.042700 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-2cbf5ae3-4b48-4b8c-a096-57241c67f5d2 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1363 microversion: 2.1 time: 0.728515 Jul 28 18:13:08.047506 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 34/73] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:07 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1363 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:08.049941 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-d21429b9-f1d7-486f-b80d-180a70ebe312 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96e9a9e40c54b6a9a7f8560e4846be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef52881d75f407a942bf960230ea22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:08.052236 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-3e51cee7-a878-41b0-9820-c2263b0bf462 req-1bc08f0b-f28f-4dbf-95b7-6372b4bce1e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b1c63c9-4f4b-4c9e-91da-42f88fd63286", "tag": "1d258458-0cee-481c-93c4-bf0b858d9e28"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:13:08.058726 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-d21429b9-f1d7-486f-b80d-180a70ebe312 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436" status: 200 len: 1314 microversion: 2.1 time: 0.761746 Jul 28 18:13:08.062389 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 40/74] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:07 2022] GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 => generated 1314 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:08.062610 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-3e51cee7-a878-41b0-9820-c2263b0bf462 req-1bc08f0b-f28f-4dbf-95b7-6372b4bce1e7 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:08.063304 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-3e51cee7-a878-41b0-9820-c2263b0bf462 req-1bc08f0b-f28f-4dbf-95b7-6372b4bce1e7 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:08.072467 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-0cc98d98-89db-4441-be3b-1f4614a5bcc9 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:08.073626 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-0cc98d98-89db-4441-be3b-1f4614a5bcc9 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:08.082265 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-0cc98d98-89db-4441-be3b-1f4614a5bcc9 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:08.083032 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-0cc98d98-89db-4441-be3b-1f4614a5bcc9 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:08.084176 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-0cc98d98-89db-4441-be3b-1f4614a5bcc9 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:08.084863 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-0cc98d98-89db-4441-be3b-1f4614a5bcc9 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:08.086870 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-3e51cee7-a878-41b0-9820-c2263b0bf462 req-1bc08f0b-f28f-4dbf-95b7-6372b4bce1e7 service nova] Creating event network-changed:1d258458-0cee-481c-93c4-bf0b858d9e28 for instance 2b1c63c9-4f4b-4c9e-91da-42f88fd63286 on hv-cinder-84617 Jul 28 18:13:08.101580 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-3e51cee7-a878-41b0-9820-c2263b0bf462 req-1bc08f0b-f28f-4dbf-95b7-6372b4bce1e7 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052617 Jul 28 18:13:08.102086 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 35/75] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:13:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:13:08.109836 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d93f73c8-a668-42e7-bc76-cfeb7981f1d3 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:08.116532 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-d93f73c8-a668-42e7-bc76-cfeb7981f1d3 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:08.139642 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d93f73c8-a668-42e7-bc76-cfeb7981f1d3 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:08.140109 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d93f73c8-a668-42e7-bc76-cfeb7981f1d3 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:08.140903 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d93f73c8-a668-42e7-bc76-cfeb7981f1d3 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:08.142603 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d93f73c8-a668-42e7-bc76-cfeb7981f1d3 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:08.390444 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-0cc98d98-89db-4441-be3b-1f4614a5bcc9 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:08.421267 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-0cc98d98-89db-4441-be3b-1f4614a5bcc9 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1322 microversion: 2.1 time: 0.346737 Jul 28 18:13:08.421267 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 41/76] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:08 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1322 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:08.432580 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [req-799fa6e7-78ce-401e-ad6e-8227d790ccf2 req-74179eef-a42a-433c-a71d-e688c085e85c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f8c8622-dfde-4eb5-95c4-7716aebf0fcd", "tag": "7d6f0f21-22dc-4e8d-82cd-162059368b29"}]} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:13:08.446751 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-799fa6e7-78ce-401e-ad6e-8227d790ccf2 req-74179eef-a42a-433c-a71d-e688c085e85c service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:08.447182 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-799fa6e7-78ce-401e-ad6e-8227d790ccf2 req-74179eef-a42a-433c-a71d-e688c085e85c service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:08.462319 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.compute.server_external_events [req-799fa6e7-78ce-401e-ad6e-8227d790ccf2 req-74179eef-a42a-433c-a71d-e688c085e85c service nova] Creating event network-changed:7d6f0f21-22dc-4e8d-82cd-162059368b29 for instance 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd on hv-cinder-84617 Jul 28 18:13:08.467209 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-d93f73c8-a668-42e7-bc76-cfeb7981f1d3 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:08.470245 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [req-799fa6e7-78ce-401e-ad6e-8227d790ccf2 req-74179eef-a42a-433c-a71d-e688c085e85c service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051872 Jul 28 18:13:08.470856 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 42/77] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:13:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:13:08.488196 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-d93f73c8-a668-42e7-bc76-cfeb7981f1d3 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:08.490318 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-d93f73c8-a668-42e7-bc76-cfeb7981f1d3 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:08.491656 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-d93f73c8-a668-42e7-bc76-cfeb7981f1d3 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1405 microversion: 2.20 time: 0.388478 Jul 28 18:13:08.507543 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 36/78] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:13:08 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1405 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:13:09.067200 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-0cb36f17-15be-4f05-bbec-0b682e66af13 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:09.067977 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-0cb36f17-15be-4f05-bbec-0b682e66af13 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:09.077158 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-0cb36f17-15be-4f05-bbec-0b682e66af13 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:09.077828 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-0cb36f17-15be-4f05-bbec-0b682e66af13 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:09.078989 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-0cb36f17-15be-4f05-bbec-0b682e66af13 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:09.079573 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-0cb36f17-15be-4f05-bbec-0b682e66af13 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:09.083767 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ef389ba9-4407-4579-bb6c-6f84c3cc2594 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:09.084467 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ef389ba9-4407-4579-bb6c-6f84c3cc2594 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:09.093395 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ef389ba9-4407-4579-bb6c-6f84c3cc2594 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:09.093395 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ef389ba9-4407-4579-bb6c-6f84c3cc2594 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:09.093395 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ef389ba9-4407-4579-bb6c-6f84c3cc2594 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:09.093395 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ef389ba9-4407-4579-bb6c-6f84c3cc2594 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:09.333862 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-0cb36f17-15be-4f05-bbec-0b682e66af13 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:09.336786 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ef389ba9-4407-4579-bb6c-6f84c3cc2594 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96e9a9e40c54b6a9a7f8560e4846be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef52881d75f407a942bf960230ea22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:09.342636 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-0cb36f17-15be-4f05-bbec-0b682e66af13 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1363 microversion: 2.1 time: 0.279983 Jul 28 18:13:09.343223 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 43/79] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:09 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1363 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:09.351011 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ef389ba9-4407-4579-bb6c-6f84c3cc2594 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436" status: 200 len: 1314 microversion: 2.1 time: 0.271798 Jul 28 18:13:09.351701 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 37/80] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:09 2022] GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:09.446831 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-83d1168b-0b5c-4b19-a312-9fbacd3d1891 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:09.447434 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-83d1168b-0b5c-4b19-a312-9fbacd3d1891 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:09.455298 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-83d1168b-0b5c-4b19-a312-9fbacd3d1891 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:09.455298 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-83d1168b-0b5c-4b19-a312-9fbacd3d1891 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:09.455298 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-83d1168b-0b5c-4b19-a312-9fbacd3d1891 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:09.455625 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-83d1168b-0b5c-4b19-a312-9fbacd3d1891 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:09.514860 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-fe7c935a-b165-46d1-a8b4-4da640c3c08b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:09.515466 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-fe7c935a-b165-46d1-a8b4-4da640c3c08b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:09.521781 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fe7c935a-b165-46d1-a8b4-4da640c3c08b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:09.522415 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fe7c935a-b165-46d1-a8b4-4da640c3c08b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:09.523704 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fe7c935a-b165-46d1-a8b4-4da640c3c08b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:09.523704 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fe7c935a-b165-46d1-a8b4-4da640c3c08b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:09.634628 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-83d1168b-0b5c-4b19-a312-9fbacd3d1891 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:09.645460 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-83d1168b-0b5c-4b19-a312-9fbacd3d1891 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1322 microversion: 2.1 time: 0.202411 Jul 28 18:13:09.646601 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 44/81] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:09 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1322 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:09.689197 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-fe7c935a-b165-46d1-a8b4-4da640c3c08b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:09.697359 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-fe7c935a-b165-46d1-a8b4-4da640c3c08b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:09.698934 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-fe7c935a-b165-46d1-a8b4-4da640c3c08b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:09.700023 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-fe7c935a-b165-46d1-a8b4-4da640c3c08b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1405 microversion: 2.20 time: 0.189367 Jul 28 18:13:09.703319 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 38/82] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:13:09 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1405 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:13:10.370890 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-1cb71659-8470-485e-aef6-228800e07ed1 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:10.372042 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-1cb71659-8470-485e-aef6-228800e07ed1 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:10.374340 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ce7d54fa-7e1b-4216-998f-50c7e37ec43a tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:10.375053 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ce7d54fa-7e1b-4216-998f-50c7e37ec43a tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:10.379403 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-1cb71659-8470-485e-aef6-228800e07ed1 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:10.379856 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-1cb71659-8470-485e-aef6-228800e07ed1 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:10.380826 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-1cb71659-8470-485e-aef6-228800e07ed1 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:10.381612 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-1cb71659-8470-485e-aef6-228800e07ed1 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:10.382054 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ce7d54fa-7e1b-4216-998f-50c7e37ec43a tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:10.382603 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ce7d54fa-7e1b-4216-998f-50c7e37ec43a tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:10.383471 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ce7d54fa-7e1b-4216-998f-50c7e37ec43a tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:10.383984 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ce7d54fa-7e1b-4216-998f-50c7e37ec43a tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:10.609837 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-1cb71659-8470-485e-aef6-228800e07ed1 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:10.617878 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-1cb71659-8470-485e-aef6-228800e07ed1 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1363 microversion: 2.1 time: 0.253310 Jul 28 18:13:10.618628 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 45/83] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:10 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1363 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:10.638961 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ce7d54fa-7e1b-4216-998f-50c7e37ec43a tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96e9a9e40c54b6a9a7f8560e4846be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef52881d75f407a942bf960230ea22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:10.646366 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ce7d54fa-7e1b-4216-998f-50c7e37ec43a tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436" status: 200 len: 1314 microversion: 2.1 time: 0.277250 Jul 28 18:13:10.646941 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 39/84] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:10 2022] GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:13:10.666379 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-951586bc-1fa2-473e-b637-9779b843ed03 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:10.667155 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-951586bc-1fa2-473e-b637-9779b843ed03 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:10.673865 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-951586bc-1fa2-473e-b637-9779b843ed03 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:10.674323 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-951586bc-1fa2-473e-b637-9779b843ed03 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:10.675089 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-951586bc-1fa2-473e-b637-9779b843ed03 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:10.675532 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-951586bc-1fa2-473e-b637-9779b843ed03 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:10.722606 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ba458933-686a-450f-af9a-2e177927db27 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:10.723216 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ba458933-686a-450f-af9a-2e177927db27 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:10.731359 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ba458933-686a-450f-af9a-2e177927db27 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:10.731359 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ba458933-686a-450f-af9a-2e177927db27 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:10.731359 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ba458933-686a-450f-af9a-2e177927db27 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:10.731359 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ba458933-686a-450f-af9a-2e177927db27 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:10.878709 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-951586bc-1fa2-473e-b637-9779b843ed03 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:10.886376 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-951586bc-1fa2-473e-b637-9779b843ed03 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1322 microversion: 2.1 time: 0.223766 Jul 28 18:13:10.886953 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 46/85] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:10 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1322 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:10.913301 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ba458933-686a-450f-af9a-2e177927db27 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:10.922411 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ba458933-686a-450f-af9a-2e177927db27 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:10.923921 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ba458933-686a-450f-af9a-2e177927db27 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:10.925054 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ba458933-686a-450f-af9a-2e177927db27 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1405 microversion: 2.20 time: 0.206765 Jul 28 18:13:10.925697 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 40/86] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:13:10 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1405 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:13:11.639547 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-b77ba908-0f07-40d3-8735-613e9b5a1142 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:11.640163 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-b77ba908-0f07-40d3-8735-613e9b5a1142 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:11.646146 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b77ba908-0f07-40d3-8735-613e9b5a1142 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:11.646592 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b77ba908-0f07-40d3-8735-613e9b5a1142 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:11.647351 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b77ba908-0f07-40d3-8735-613e9b5a1142 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:11.647788 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b77ba908-0f07-40d3-8735-613e9b5a1142 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:11.667615 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-9a1bd2ae-b769-4950-aed0-668a004821bd tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:11.668286 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-9a1bd2ae-b769-4950-aed0-668a004821bd tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:11.674355 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9a1bd2ae-b769-4950-aed0-668a004821bd tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:11.674781 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9a1bd2ae-b769-4950-aed0-668a004821bd tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:11.675535 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9a1bd2ae-b769-4950-aed0-668a004821bd tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:11.675976 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9a1bd2ae-b769-4950-aed0-668a004821bd tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:11.858684 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-b77ba908-0f07-40d3-8735-613e9b5a1142 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:11.866107 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-b77ba908-0f07-40d3-8735-613e9b5a1142 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1363 microversion: 2.1 time: 0.230939 Jul 28 18:13:11.866678 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 47/87] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:11 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1363 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:11.880657 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-9a1bd2ae-b769-4950-aed0-668a004821bd tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96e9a9e40c54b6a9a7f8560e4846be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef52881d75f407a942bf960230ea22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:11.886152 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:13:11.892547 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-9a1bd2ae-b769-4950-aed0-668a004821bd tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436" status: 200 len: 1314 microversion: 2.1 time: 0.229600 Jul 28 18:13:11.893168 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 41/88] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:11 2022] GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:13:11.912346 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-5f98cf9f-1eec-401c-aa1e-7406f86b8c3d tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:11.913083 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-5f98cf9f-1eec-401c-aa1e-7406f86b8c3d tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:11.919629 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-5f98cf9f-1eec-401c-aa1e-7406f86b8c3d tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:11.920083 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-5f98cf9f-1eec-401c-aa1e-7406f86b8c3d tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:11.920856 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-5f98cf9f-1eec-401c-aa1e-7406f86b8c3d tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:11.921327 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-5f98cf9f-1eec-401c-aa1e-7406f86b8c3d tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:11.939632 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell1:SELECT=100 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:13:11.947718 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-29c3bc1f-9c4c-4e10-891f-ae0cdd94bc85 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:11.948324 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-29c3bc1f-9c4c-4e10-891f-ae0cdd94bc85 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:11.955113 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-29c3bc1f-9c4c-4e10-891f-ae0cdd94bc85 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:11.958380 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-29c3bc1f-9c4c-4e10-891f-ae0cdd94bc85 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:11.958380 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-29c3bc1f-9c4c-4e10-891f-ae0cdd94bc85 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:11.958380 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-29c3bc1f-9c4c-4e10-891f-ae0cdd94bc85 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:12.109582 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-5f98cf9f-1eec-401c-aa1e-7406f86b8c3d tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:12.117317 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-5f98cf9f-1eec-401c-aa1e-7406f86b8c3d tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1322 microversion: 2.1 time: 0.208804 Jul 28 18:13:12.117904 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 48/89] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:11 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:12.139260 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-29c3bc1f-9c4c-4e10-891f-ae0cdd94bc85 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:12.147438 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-29c3bc1f-9c4c-4e10-891f-ae0cdd94bc85 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:12.148995 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-29c3bc1f-9c4c-4e10-891f-ae0cdd94bc85 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:12.150125 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-29c3bc1f-9c4c-4e10-891f-ae0cdd94bc85 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1405 microversion: 2.20 time: 0.206429 Jul 28 18:13:12.150802 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 42/90] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:13:11 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1405 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:13:12.891806 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-997ffb38-86d4-4273-87e4-07e5162a111f tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:12.892452 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-997ffb38-86d4-4273-87e4-07e5162a111f tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:12.899194 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-997ffb38-86d4-4273-87e4-07e5162a111f tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:12.899648 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-997ffb38-86d4-4273-87e4-07e5162a111f tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:12.900413 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-997ffb38-86d4-4273-87e4-07e5162a111f tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:12.900855 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-997ffb38-86d4-4273-87e4-07e5162a111f tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:12.916081 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-c876f9b4-7c99-4bdd-8111-5a7f6cd7d858 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:12.917276 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-c876f9b4-7c99-4bdd-8111-5a7f6cd7d858 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:12.924653 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c876f9b4-7c99-4bdd-8111-5a7f6cd7d858 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:12.925173 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c876f9b4-7c99-4bdd-8111-5a7f6cd7d858 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:12.925945 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c876f9b4-7c99-4bdd-8111-5a7f6cd7d858 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:12.931895 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c876f9b4-7c99-4bdd-8111-5a7f6cd7d858 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:13.144031 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-997ffb38-86d4-4273-87e4-07e5162a111f tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:13.148691 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-c876f9b4-7c99-4bdd-8111-5a7f6cd7d858 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96e9a9e40c54b6a9a7f8560e4846be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef52881d75f407a942bf960230ea22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:13.149126 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-997ffb38-86d4-4273-87e4-07e5162a111f tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1363 microversion: 2.1 time: 0.261125 Jul 28 18:13:13.149715 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 49/91] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:12 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1363 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:13:13.154811 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-ca83f816-cd16-4a59-92df-df24a6d7b61d tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:13.155812 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-ca83f816-cd16-4a59-92df-df24a6d7b61d tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:13.156444 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-c876f9b4-7c99-4bdd-8111-5a7f6cd7d858 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436" status: 200 len: 1314 microversion: 2.1 time: 0.244116 Jul 28 18:13:13.163260 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ca83f816-cd16-4a59-92df-df24a6d7b61d tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:13.163717 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ca83f816-cd16-4a59-92df-df24a6d7b61d tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:13.164579 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ca83f816-cd16-4a59-92df-df24a6d7b61d tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:13.165226 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ca83f816-cd16-4a59-92df-df24a6d7b61d tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:13.169967 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 43/92] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:12 2022] GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:13.176460 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-4c8c6a31-a298-4a64-b022-b37377f8a69c tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:13.177104 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-4c8c6a31-a298-4a64-b022-b37377f8a69c tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:13.183077 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4c8c6a31-a298-4a64-b022-b37377f8a69c tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:13.183526 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4c8c6a31-a298-4a64-b022-b37377f8a69c tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:13.185512 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4c8c6a31-a298-4a64-b022-b37377f8a69c tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:13.185967 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4c8c6a31-a298-4a64-b022-b37377f8a69c tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:13.370389 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-ca83f816-cd16-4a59-92df-df24a6d7b61d tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:13.377440 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-4c8c6a31-a298-4a64-b022-b37377f8a69c tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:13.378233 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-ca83f816-cd16-4a59-92df-df24a6d7b61d tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1322 microversion: 2.1 time: 0.227091 Jul 28 18:13:13.378813 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 50/93] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:13 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1322 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:13.385867 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-4c8c6a31-a298-4a64-b022-b37377f8a69c tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:13.387484 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-4c8c6a31-a298-4a64-b022-b37377f8a69c tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:13.388750 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-4c8c6a31-a298-4a64-b022-b37377f8a69c tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1405 microversion: 2.20 time: 0.217626 Jul 28 18:13:13.389329 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 44/94] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:13:13 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1405 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:13:14.170822 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-5ef55a5f-dbb1-40b0-82bf-b4735e54a726 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:14.171441 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-5ef55a5f-dbb1-40b0-82bf-b4735e54a726 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:14.177654 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-5ef55a5f-dbb1-40b0-82bf-b4735e54a726 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:14.178111 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-5ef55a5f-dbb1-40b0-82bf-b4735e54a726 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:14.178889 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-5ef55a5f-dbb1-40b0-82bf-b4735e54a726 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:14.179147 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ae3046ac-2b48-4600-aea5-d41ee6d3e73f tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:14.179610 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-5ef55a5f-dbb1-40b0-82bf-b4735e54a726 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:14.179888 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ae3046ac-2b48-4600-aea5-d41ee6d3e73f tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:14.186601 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ae3046ac-2b48-4600-aea5-d41ee6d3e73f tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:14.187057 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ae3046ac-2b48-4600-aea5-d41ee6d3e73f tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:14.187870 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ae3046ac-2b48-4600-aea5-d41ee6d3e73f tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:14.188312 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ae3046ac-2b48-4600-aea5-d41ee6d3e73f tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:14.378755 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-5ef55a5f-dbb1-40b0-82bf-b4735e54a726 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:14.381903 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ae3046ac-2b48-4600-aea5-d41ee6d3e73f tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96e9a9e40c54b6a9a7f8560e4846be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef52881d75f407a942bf960230ea22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:14.386595 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-5ef55a5f-dbb1-40b0-82bf-b4735e54a726 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1363 microversion: 2.1 time: 0.219651 Jul 28 18:13:14.387172 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 51/95] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:14 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1363 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:14.390309 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ae3046ac-2b48-4600-aea5-d41ee6d3e73f tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436" status: 200 len: 1314 microversion: 2.1 time: 0.215144 Jul 28 18:13:14.391686 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 45/96] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:14 2022] GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:13:14.398411 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-798dba2b-8e43-4994-b5ef-c6753cdff9b5 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:14.399150 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-798dba2b-8e43-4994-b5ef-c6753cdff9b5 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:14.405282 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-798dba2b-8e43-4994-b5ef-c6753cdff9b5 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:14.405850 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-798dba2b-8e43-4994-b5ef-c6753cdff9b5 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:14.406729 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-798dba2b-8e43-4994-b5ef-c6753cdff9b5 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:14.407278 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-798dba2b-8e43-4994-b5ef-c6753cdff9b5 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:14.410724 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-722d8410-202b-4a83-95a8-83f607902529 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:14.411395 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-722d8410-202b-4a83-95a8-83f607902529 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:14.417848 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-722d8410-202b-4a83-95a8-83f607902529 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:14.418294 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-722d8410-202b-4a83-95a8-83f607902529 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:14.419566 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-722d8410-202b-4a83-95a8-83f607902529 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:14.420000 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-722d8410-202b-4a83-95a8-83f607902529 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:14.613296 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-798dba2b-8e43-4994-b5ef-c6753cdff9b5 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:14.616832 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-722d8410-202b-4a83-95a8-83f607902529 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:14.623424 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-798dba2b-8e43-4994-b5ef-c6753cdff9b5 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1322 microversion: 2.1 time: 0.228660 Jul 28 18:13:14.625067 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 52/97] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:14 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1322 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:13:14.625914 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-722d8410-202b-4a83-95a8-83f607902529 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:14.627510 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-722d8410-202b-4a83-95a8-83f607902529 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:14.628663 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-722d8410-202b-4a83-95a8-83f607902529 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1405 microversion: 2.20 time: 0.221875 Jul 28 18:13:14.629247 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 46/98] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:13:14 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1405 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:13:15.409388 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-38f6cdab-6620-4604-a742-bc11019dd842 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:15.410005 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-38f6cdab-6620-4604-a742-bc11019dd842 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:15.410643 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-1708a36e-1615-49a0-a6c5-7f92f32275f1 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:15.411277 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-1708a36e-1615-49a0-a6c5-7f92f32275f1 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:15.411945 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell0:SELECT=2 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:13:15.416920 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-38f6cdab-6620-4604-a742-bc11019dd842 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:15.417327 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1708a36e-1615-49a0-a6c5-7f92f32275f1 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:15.417444 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-38f6cdab-6620-4604-a742-bc11019dd842 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:15.417815 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1708a36e-1615-49a0-a6c5-7f92f32275f1 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:15.418165 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-38f6cdab-6620-4604-a742-bc11019dd842 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:15.418585 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1708a36e-1615-49a0-a6c5-7f92f32275f1 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:15.418682 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-38f6cdab-6620-4604-a742-bc11019dd842 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:15.419024 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1708a36e-1615-49a0-a6c5-7f92f32275f1 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:15.621700 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-1708a36e-1615-49a0-a6c5-7f92f32275f1 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96e9a9e40c54b6a9a7f8560e4846be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef52881d75f407a942bf960230ea22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:15.625564 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-38f6cdab-6620-4604-a742-bc11019dd842 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:15.629670 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-1708a36e-1615-49a0-a6c5-7f92f32275f1 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436" status: 200 len: 1314 microversion: 2.1 time: 0.222785 Jul 28 18:13:15.630255 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 47/99] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:15 2022] GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:13:15.632902 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-38f6cdab-6620-4604-a742-bc11019dd842 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1363 microversion: 2.1 time: 0.227662 Jul 28 18:13:15.633488 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 53/100] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:15 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1363 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:15.644580 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f0252db1-a128-422e-846d-5e8750d63780 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:15.645331 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f0252db1-a128-422e-846d-5e8750d63780 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:15.650502 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-4b08e250-4fde-4690-8108-0d26382a8e25 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:15.651118 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-4b08e250-4fde-4690-8108-0d26382a8e25 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:15.651705 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f0252db1-a128-422e-846d-5e8750d63780 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:15.652163 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f0252db1-a128-422e-846d-5e8750d63780 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:15.652929 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f0252db1-a128-422e-846d-5e8750d63780 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:15.653390 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f0252db1-a128-422e-846d-5e8750d63780 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:15.657382 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-4b08e250-4fde-4690-8108-0d26382a8e25 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:15.657835 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-4b08e250-4fde-4690-8108-0d26382a8e25 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:15.658604 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-4b08e250-4fde-4690-8108-0d26382a8e25 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:15.659049 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-4b08e250-4fde-4690-8108-0d26382a8e25 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:15.856250 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-4b08e250-4fde-4690-8108-0d26382a8e25 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:15.859788 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f0252db1-a128-422e-846d-5e8750d63780 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:15.865413 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-4b08e250-4fde-4690-8108-0d26382a8e25 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:15.867024 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-4b08e250-4fde-4690-8108-0d26382a8e25 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:15.867211 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f0252db1-a128-422e-846d-5e8750d63780 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1322 microversion: 2.1 time: 0.226312 Jul 28 18:13:15.867945 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 48/101] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:15 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1322 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:15.868339 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-4b08e250-4fde-4690-8108-0d26382a8e25 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1405 microversion: 2.20 time: 0.221654 Jul 28 18:13:15.868990 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 54/102] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:13:15 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1405 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:13:16.651233 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-6108dc9d-a3a0-4d24-a6ed-0f9f58c5cccc tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:16.651870 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-6108dc9d-a3a0-4d24-a6ed-0f9f58c5cccc tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:16.653400 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-112c25ba-183a-4f23-bd9e-6650ec6ae76b tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:16.654026 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-112c25ba-183a-4f23-bd9e-6650ec6ae76b tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:16.659824 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6108dc9d-a3a0-4d24-a6ed-0f9f58c5cccc tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:16.660022 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-112c25ba-183a-4f23-bd9e-6650ec6ae76b tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:16.660269 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6108dc9d-a3a0-4d24-a6ed-0f9f58c5cccc tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:16.660476 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-112c25ba-183a-4f23-bd9e-6650ec6ae76b tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:16.661053 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6108dc9d-a3a0-4d24-a6ed-0f9f58c5cccc tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:16.661280 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-112c25ba-183a-4f23-bd9e-6650ec6ae76b tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:16.661484 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6108dc9d-a3a0-4d24-a6ed-0f9f58c5cccc tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:16.661725 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-112c25ba-183a-4f23-bd9e-6650ec6ae76b tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:16.866511 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-112c25ba-183a-4f23-bd9e-6650ec6ae76b tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:16.872054 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-6108dc9d-a3a0-4d24-a6ed-0f9f58c5cccc tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96e9a9e40c54b6a9a7f8560e4846be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef52881d75f407a942bf960230ea22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:16.883753 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-6108dc9d-a3a0-4d24-a6ed-0f9f58c5cccc tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436" status: 200 len: 1314 microversion: 2.1 time: 0.236361 Jul 28 18:13:16.884337 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 49/103] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:16 2022] GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:16.889393 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-112c25ba-183a-4f23-bd9e-6650ec6ae76b tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1363 microversion: 2.1 time: 0.237577 Jul 28 18:13:16.896547 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 55/104] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:16 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1363 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:13:16.896547 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-3b371400-95b9-4b50-86a7-954e0230f6a2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:16.896547 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-3b371400-95b9-4b50-86a7-954e0230f6a2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:16.897284 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a43760f4-b70e-4ed9-87d9-b3170108f141 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:16.897998 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-a43760f4-b70e-4ed9-87d9-b3170108f141 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:16.901968 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-3b371400-95b9-4b50-86a7-954e0230f6a2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:16.902366 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-3b371400-95b9-4b50-86a7-954e0230f6a2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:16.903142 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-3b371400-95b9-4b50-86a7-954e0230f6a2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:16.903587 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-3b371400-95b9-4b50-86a7-954e0230f6a2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:16.910296 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a43760f4-b70e-4ed9-87d9-b3170108f141 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:16.910752 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a43760f4-b70e-4ed9-87d9-b3170108f141 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:16.911527 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a43760f4-b70e-4ed9-87d9-b3170108f141 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:16.911969 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a43760f4-b70e-4ed9-87d9-b3170108f141 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:17.099282 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-a43760f4-b70e-4ed9-87d9-b3170108f141 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:17.103368 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-3b371400-95b9-4b50-86a7-954e0230f6a2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:17.106730 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-a43760f4-b70e-4ed9-87d9-b3170108f141 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1322 microversion: 2.1 time: 0.221017 Jul 28 18:13:17.107299 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 50/105] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:16 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:17.112340 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-3b371400-95b9-4b50-86a7-954e0230f6a2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:17.113881 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-3b371400-95b9-4b50-86a7-954e0230f6a2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:17.114986 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-3b371400-95b9-4b50-86a7-954e0230f6a2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1405 microversion: 2.20 time: 0.223642 Jul 28 18:13:17.115592 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 56/106] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:13:16 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1405 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:13:17.718915 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-561b4da3-c28a-4521-8a1d-9259c0e8e890 req-cb1b8946-bca1-43b6-aa69-ea08a012c1d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b81a4ab-5e71-4dd6-bed5-1a068b1ca436", "name": "network-vif-plugged", "status": "completed", "tag": "dc5628c1-5dbb-402d-9159-d05b64b9abb0"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:13:17.728256 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-561b4da3-c28a-4521-8a1d-9259c0e8e890 req-cb1b8946-bca1-43b6-aa69-ea08a012c1d3 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:17.735275 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-561b4da3-c28a-4521-8a1d-9259c0e8e890 req-cb1b8946-bca1-43b6-aa69-ea08a012c1d3 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:17.739934 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-561b4da3-c28a-4521-8a1d-9259c0e8e890 req-cb1b8946-bca1-43b6-aa69-ea08a012c1d3 service nova] Creating event network-vif-plugged:dc5628c1-5dbb-402d-9159-d05b64b9abb0 for instance 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 on hv-cinder-84617 Jul 28 18:13:17.744905 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-561b4da3-c28a-4521-8a1d-9259c0e8e890 req-cb1b8946-bca1-43b6-aa69-ea08a012c1d3 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089451 Jul 28 18:13:17.745558 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 51/107] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:13:17.904667 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-c9c77387-b537-4897-9444-238094866dba tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:17.905322 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-c9c77387-b537-4897-9444-238094866dba tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:17.911847 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c9c77387-b537-4897-9444-238094866dba tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:17.912296 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c9c77387-b537-4897-9444-238094866dba tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:17.913097 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c9c77387-b537-4897-9444-238094866dba tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:17.913551 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c9c77387-b537-4897-9444-238094866dba tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:17.914868 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-cd11069d-9255-4f1f-98d2-df4bb360f1f0 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:17.915726 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-cd11069d-9255-4f1f-98d2-df4bb360f1f0 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:17.925657 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cd11069d-9255-4f1f-98d2-df4bb360f1f0 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:17.926508 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cd11069d-9255-4f1f-98d2-df4bb360f1f0 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:17.927581 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cd11069d-9255-4f1f-98d2-df4bb360f1f0 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:17.929632 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cd11069d-9255-4f1f-98d2-df4bb360f1f0 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:18.213015 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-cd11069d-9255-4f1f-98d2-df4bb360f1f0 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:18.221739 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-cd11069d-9255-4f1f-98d2-df4bb360f1f0 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1363 microversion: 2.1 time: 0.310989 Jul 28 18:13:18.226642 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-c9c77387-b537-4897-9444-238094866dba tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96e9a9e40c54b6a9a7f8560e4846be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef52881d75f407a942bf960230ea22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:18.234615 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 52/108] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:17 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1363 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:13:18.237102 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-c9c77387-b537-4897-9444-238094866dba tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436" status: 200 len: 1314 microversion: 2.1 time: 0.337277 Jul 28 18:13:18.238093 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 57/109] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:17 2022] GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 => generated 1314 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:18.240540 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-56ec1738-7692-4954-a567-1a24d982258b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:18.241241 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-56ec1738-7692-4954-a567-1a24d982258b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:18.246335 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-37e11368-5328-4714-9758-b553765ce84e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:18.248144 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-37e11368-5328-4714-9758-b553765ce84e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:18.254523 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-37e11368-5328-4714-9758-b553765ce84e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:18.255053 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-37e11368-5328-4714-9758-b553765ce84e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:18.256270 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-37e11368-5328-4714-9758-b553765ce84e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:18.256806 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-37e11368-5328-4714-9758-b553765ce84e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:18.259972 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-56ec1738-7692-4954-a567-1a24d982258b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:18.260430 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-56ec1738-7692-4954-a567-1a24d982258b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:18.261236 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-56ec1738-7692-4954-a567-1a24d982258b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:18.261847 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-56ec1738-7692-4954-a567-1a24d982258b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:18.454272 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-37e11368-5328-4714-9758-b553765ce84e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:18.470533 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-56ec1738-7692-4954-a567-1a24d982258b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:18.470924 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-37e11368-5328-4714-9758-b553765ce84e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:18.470924 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-37e11368-5328-4714-9758-b553765ce84e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:18.470924 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-37e11368-5328-4714-9758-b553765ce84e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1405 microversion: 2.20 time: 0.226618 Jul 28 18:13:18.471127 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 58/110] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:13:18 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1405 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:13:18.475193 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-56ec1738-7692-4954-a567-1a24d982258b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1322 microversion: 2.1 time: 0.240500 Jul 28 18:13:18.475937 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 53/111] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:18 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1322 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:19.246348 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-3cae573b-171d-4904-a5d0-4c3807254837 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:19.247001 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-3cae573b-171d-4904-a5d0-4c3807254837 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:19.253762 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-3cae573b-171d-4904-a5d0-4c3807254837 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:19.254405 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-3cae573b-171d-4904-a5d0-4c3807254837 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:19.255322 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-3cae573b-171d-4904-a5d0-4c3807254837 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:19.255940 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-3cae573b-171d-4904-a5d0-4c3807254837 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:19.260274 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-134572e4-c003-48a7-ac20-6d3cf3e3c786 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:19.260889 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-134572e4-c003-48a7-ac20-6d3cf3e3c786 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:19.268932 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-134572e4-c003-48a7-ac20-6d3cf3e3c786 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:19.269421 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-134572e4-c003-48a7-ac20-6d3cf3e3c786 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:19.270627 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-134572e4-c003-48a7-ac20-6d3cf3e3c786 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:19.271216 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-134572e4-c003-48a7-ac20-6d3cf3e3c786 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:19.660421 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-3cae573b-171d-4904-a5d0-4c3807254837 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:19.670179 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-3cae573b-171d-4904-a5d0-4c3807254837 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1363 microversion: 2.1 time: 0.427318 Jul 28 18:13:19.682216 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-134572e4-c003-48a7-ac20-6d3cf3e3c786 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96e9a9e40c54b6a9a7f8560e4846be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef52881d75f407a942bf960230ea22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:19.683089 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 59/112] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:19 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1363 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:19.684225 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-134572e4-c003-48a7-ac20-6d3cf3e3c786 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436" status: 200 len: 1314 microversion: 2.1 time: 0.428341 Jul 28 18:13:19.686005 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 54/113] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:19 2022] GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 => generated 1314 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:13:19.694170 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b3631e99-6955-49f1-b488-a2e58b11f107 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:19.697089 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b3631e99-6955-49f1-b488-a2e58b11f107 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:19.703463 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-ae359452-cfe5-4046-9b94-ca09d5f2f998 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:19.704118 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-ae359452-cfe5-4046-9b94-ca09d5f2f998 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:19.710167 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ae359452-cfe5-4046-9b94-ca09d5f2f998 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:19.710619 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ae359452-cfe5-4046-9b94-ca09d5f2f998 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:19.710935 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b3631e99-6955-49f1-b488-a2e58b11f107 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:19.711408 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b3631e99-6955-49f1-b488-a2e58b11f107 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:19.712838 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ae359452-cfe5-4046-9b94-ca09d5f2f998 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:19.712838 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ae359452-cfe5-4046-9b94-ca09d5f2f998 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:19.713056 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b3631e99-6955-49f1-b488-a2e58b11f107 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:19.713056 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b3631e99-6955-49f1-b488-a2e58b11f107 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:19.908319 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-ae359452-cfe5-4046-9b94-ca09d5f2f998 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:19.920266 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-ae359452-cfe5-4046-9b94-ca09d5f2f998 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:19.920580 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b3631e99-6955-49f1-b488-a2e58b11f107 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:19.921821 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-ae359452-cfe5-4046-9b94-ca09d5f2f998 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:19.934016 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b3631e99-6955-49f1-b488-a2e58b11f107 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1322 microversion: 2.1 time: 0.246211 Jul 28 18:13:19.937048 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 55/114] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:19 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1322 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:19.940059 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-ae359452-cfe5-4046-9b94-ca09d5f2f998 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1405 microversion: 2.20 time: 0.255670 Jul 28 18:13:19.940632 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 60/115] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:13:19 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1405 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:13:20.706438 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-db8107f5-1b88-492a-882d-09f3510545f9 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:20.707045 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-db8107f5-1b88-492a-882d-09f3510545f9 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:20.710947 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-8addaaf6-6a57-43f1-b872-25ce439d1047 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:20.712098 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-8addaaf6-6a57-43f1-b872-25ce439d1047 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:20.713244 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-db8107f5-1b88-492a-882d-09f3510545f9 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:20.713877 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-db8107f5-1b88-492a-882d-09f3510545f9 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:20.714835 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-db8107f5-1b88-492a-882d-09f3510545f9 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:20.715278 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-db8107f5-1b88-492a-882d-09f3510545f9 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:20.724097 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-8addaaf6-6a57-43f1-b872-25ce439d1047 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:20.724628 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-8addaaf6-6a57-43f1-b872-25ce439d1047 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:20.725518 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-8addaaf6-6a57-43f1-b872-25ce439d1047 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:20.726167 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-8addaaf6-6a57-43f1-b872-25ce439d1047 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:21.149289 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-8addaaf6-6a57-43f1-b872-25ce439d1047 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96e9a9e40c54b6a9a7f8560e4846be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef52881d75f407a942bf960230ea22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:21.156995 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-8addaaf6-6a57-43f1-b872-25ce439d1047 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436" status: 200 len: 1314 microversion: 2.1 time: 0.450720 Jul 28 18:13:21.157587 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 61/116] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:20 2022] GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 => generated 1314 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:13:21.162058 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-43c4069c-1b6e-4731-aca3-4fe56510ac75 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:21.162660 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-43c4069c-1b6e-4731-aca3-4fe56510ac75 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:21.168977 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-43c4069c-1b6e-4731-aca3-4fe56510ac75 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:21.169446 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-43c4069c-1b6e-4731-aca3-4fe56510ac75 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:21.171063 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-43c4069c-1b6e-4731-aca3-4fe56510ac75 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:21.171201 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-43c4069c-1b6e-4731-aca3-4fe56510ac75 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:21.182274 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-db8107f5-1b88-492a-882d-09f3510545f9 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:21.192072 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-db8107f5-1b88-492a-882d-09f3510545f9 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1363 microversion: 2.1 time: 0.489573 Jul 28 18:13:21.192655 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 56/117] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:20 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1363 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:21.197381 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a0de8b99-72ef-4854-85d3-fe214812062b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:21.197984 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-a0de8b99-72ef-4854-85d3-fe214812062b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:21.204473 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a0de8b99-72ef-4854-85d3-fe214812062b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:21.204919 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a0de8b99-72ef-4854-85d3-fe214812062b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:21.205712 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a0de8b99-72ef-4854-85d3-fe214812062b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:21.206145 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a0de8b99-72ef-4854-85d3-fe214812062b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:21.367117 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-43c4069c-1b6e-4731-aca3-4fe56510ac75 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:21.380942 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-43c4069c-1b6e-4731-aca3-4fe56510ac75 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1322 microversion: 2.1 time: 0.222302 Jul 28 18:13:21.384167 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 62/118] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:21 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:21.414903 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-a0de8b99-72ef-4854-85d3-fe214812062b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:21.424255 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-a0de8b99-72ef-4854-85d3-fe214812062b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:21.426108 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-a0de8b99-72ef-4854-85d3-fe214812062b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:21.427244 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-a0de8b99-72ef-4854-85d3-fe214812062b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1405 microversion: 2.20 time: 0.233467 Jul 28 18:13:21.427847 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 57/119] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:13:21 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1405 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:13:21.657503 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [req-79ae6148-39ea-45a9-a3b4-87fcd0665b21 req-5ce7ebcd-f94c-493d-a2df-6febc0e92487 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1", "name": "network-vif-plugged", "status": "completed", "tag": "f42a05fc-306d-49b7-863f-7888a1c5f431"}]} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:13:21.672638 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-79ae6148-39ea-45a9-a3b4-87fcd0665b21 req-5ce7ebcd-f94c-493d-a2df-6febc0e92487 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:21.673163 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-79ae6148-39ea-45a9-a3b4-87fcd0665b21 req-5ce7ebcd-f94c-493d-a2df-6febc0e92487 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:21.689405 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.compute.server_external_events [req-79ae6148-39ea-45a9-a3b4-87fcd0665b21 req-5ce7ebcd-f94c-493d-a2df-6febc0e92487 service nova] Creating event network-vif-plugged:f42a05fc-306d-49b7-863f-7888a1c5f431 for instance 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 on hv-cinder-84617 Jul 28 18:13:21.695928 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [req-79ae6148-39ea-45a9-a3b4-87fcd0665b21 req-5ce7ebcd-f94c-493d-a2df-6febc0e92487 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044094 Jul 28 18:13:21.701169 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 63/120] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 18:13:22.178333 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-042a1ac3-fd7d-48a7-b987-15c91495991e tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:22.178944 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-042a1ac3-fd7d-48a7-b987-15c91495991e tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:22.185080 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-042a1ac3-fd7d-48a7-b987-15c91495991e tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:22.186125 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-042a1ac3-fd7d-48a7-b987-15c91495991e tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:22.186886 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-042a1ac3-fd7d-48a7-b987-15c91495991e tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:22.187328 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-042a1ac3-fd7d-48a7-b987-15c91495991e tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:22.213678 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-f681de96-3c34-4d18-851c-445d55586cab tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:22.214396 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-f681de96-3c34-4d18-851c-445d55586cab tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:22.221297 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f681de96-3c34-4d18-851c-445d55586cab tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:22.221746 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f681de96-3c34-4d18-851c-445d55586cab tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:22.222512 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f681de96-3c34-4d18-851c-445d55586cab tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:22.222949 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f681de96-3c34-4d18-851c-445d55586cab tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:22.368154 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-042a1ac3-fd7d-48a7-b987-15c91495991e tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96e9a9e40c54b6a9a7f8560e4846be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef52881d75f407a942bf960230ea22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:22.376010 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-042a1ac3-fd7d-48a7-b987-15c91495991e tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436" status: 200 len: 1314 microversion: 2.1 time: 0.201476 Jul 28 18:13:22.376594 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 58/121] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:22 2022] GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:22.394770 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-f681de96-3c34-4d18-851c-445d55586cab tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:22.402309 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-f681de96-3c34-4d18-851c-445d55586cab tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1363 microversion: 2.1 time: 0.192791 Jul 28 18:13:22.402876 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 64/122] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:22 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1363 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:13:22.403765 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-2771246e-9f9e-44df-9869-fe66e4284910 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:22.404373 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-2771246e-9f9e-44df-9869-fe66e4284910 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:22.410728 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2771246e-9f9e-44df-9869-fe66e4284910 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:22.411237 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2771246e-9f9e-44df-9869-fe66e4284910 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:22.411999 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2771246e-9f9e-44df-9869-fe66e4284910 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:22.412436 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2771246e-9f9e-44df-9869-fe66e4284910 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:22.415222 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:13:22.450350 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-396a756a-ef10-4431-94d6-fcfb305a089c tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:22.451559 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-396a756a-ef10-4431-94d6-fcfb305a089c tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:22.457649 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-396a756a-ef10-4431-94d6-fcfb305a089c tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:22.458103 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-396a756a-ef10-4431-94d6-fcfb305a089c tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:22.458876 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-396a756a-ef10-4431-94d6-fcfb305a089c tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:22.459314 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-396a756a-ef10-4431-94d6-fcfb305a089c tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:22.594730 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-2771246e-9f9e-44df-9869-fe66e4284910 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:22.602414 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-2771246e-9f9e-44df-9869-fe66e4284910 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1322 microversion: 2.1 time: 0.202343 Jul 28 18:13:22.602990 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 59/123] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:22 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1322 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:13:22.621706 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-396a756a-ef10-4431-94d6-fcfb305a089c tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:22.625912 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell1:SELECT=100 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:13:22.631383 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-396a756a-ef10-4431-94d6-fcfb305a089c tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:22.632887 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-396a756a-ef10-4431-94d6-fcfb305a089c tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:22.636082 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-396a756a-ef10-4431-94d6-fcfb305a089c tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1405 microversion: 2.20 time: 0.187612 Jul 28 18:13:22.636082 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 65/124] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:13:22 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1405 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:13:23.397626 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-2f723a8d-b0f4-4bd0-8431-029bb232f712 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:23.398267 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-2f723a8d-b0f4-4bd0-8431-029bb232f712 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:23.404267 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2f723a8d-b0f4-4bd0-8431-029bb232f712 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:23.404714 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2f723a8d-b0f4-4bd0-8431-029bb232f712 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:23.405505 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2f723a8d-b0f4-4bd0-8431-029bb232f712 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:23.405939 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2f723a8d-b0f4-4bd0-8431-029bb232f712 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:23.425282 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-ec063fca-4d91-44ad-aed3-0196da3c3cbd tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:23.425924 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-ec063fca-4d91-44ad-aed3-0196da3c3cbd tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:23.432135 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ec063fca-4d91-44ad-aed3-0196da3c3cbd tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:23.432587 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ec063fca-4d91-44ad-aed3-0196da3c3cbd tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:23.433537 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ec063fca-4d91-44ad-aed3-0196da3c3cbd tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:23.433983 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ec063fca-4d91-44ad-aed3-0196da3c3cbd tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:23.582068 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-2f723a8d-b0f4-4bd0-8431-029bb232f712 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96e9a9e40c54b6a9a7f8560e4846be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef52881d75f407a942bf960230ea22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:23.589480 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-2f723a8d-b0f4-4bd0-8431-029bb232f712 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436" status: 200 len: 1314 microversion: 2.1 time: 0.195740 Jul 28 18:13:23.590055 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 60/125] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:23 2022] GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:23.608522 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-ec063fca-4d91-44ad-aed3-0196da3c3cbd tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:23.616535 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-ec063fca-4d91-44ad-aed3-0196da3c3cbd tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1363 microversion: 2.1 time: 0.197632 Jul 28 18:13:23.617130 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 66/126] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:23 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1363 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:13:23.622286 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3fcadf5c-9e6c-465b-812f-02cb6402b6dc tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:23.622893 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3fcadf5c-9e6c-465b-812f-02cb6402b6dc tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:23.629478 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3fcadf5c-9e6c-465b-812f-02cb6402b6dc tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:23.629928 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3fcadf5c-9e6c-465b-812f-02cb6402b6dc tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:23.630696 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3fcadf5c-9e6c-465b-812f-02cb6402b6dc tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:23.631136 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3fcadf5c-9e6c-465b-812f-02cb6402b6dc tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:23.657460 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-82fbcefb-a910-4be9-a7cf-75b2337903d9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:23.658069 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-82fbcefb-a910-4be9-a7cf-75b2337903d9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:23.664248 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-82fbcefb-a910-4be9-a7cf-75b2337903d9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:23.664732 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-82fbcefb-a910-4be9-a7cf-75b2337903d9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:23.665523 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-82fbcefb-a910-4be9-a7cf-75b2337903d9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:23.665960 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-82fbcefb-a910-4be9-a7cf-75b2337903d9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:23.824580 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-3fcadf5c-9e6c-465b-812f-02cb6402b6dc tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:23.833388 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-3fcadf5c-9e6c-465b-812f-02cb6402b6dc tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1322 microversion: 2.1 time: 0.214850 Jul 28 18:13:23.834141 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 61/127] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:23 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:23.841236 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-82fbcefb-a910-4be9-a7cf-75b2337903d9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:23.849620 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-82fbcefb-a910-4be9-a7cf-75b2337903d9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:23.851143 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-82fbcefb-a910-4be9-a7cf-75b2337903d9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:23.852254 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-82fbcefb-a910-4be9-a7cf-75b2337903d9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1405 microversion: 2.20 time: 0.199116 Jul 28 18:13:23.852865 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 67/128] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:13:23 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1405 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:13:24.611861 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-69a281a1-b019-491b-b899-9ce2ed848ce1 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:24.612470 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-69a281a1-b019-491b-b899-9ce2ed848ce1 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:24.622236 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-69a281a1-b019-491b-b899-9ce2ed848ce1 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:24.622695 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-69a281a1-b019-491b-b899-9ce2ed848ce1 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:24.627146 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-69a281a1-b019-491b-b899-9ce2ed848ce1 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:24.627612 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-69a281a1-b019-491b-b899-9ce2ed848ce1 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:24.637800 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-05118e24-24a3-449f-9e86-8a647f760f24 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:24.638436 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-05118e24-24a3-449f-9e86-8a647f760f24 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:24.644791 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-05118e24-24a3-449f-9e86-8a647f760f24 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:24.645392 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-05118e24-24a3-449f-9e86-8a647f760f24 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:24.646181 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-05118e24-24a3-449f-9e86-8a647f760f24 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:24.646622 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-05118e24-24a3-449f-9e86-8a647f760f24 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:24.849193 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-05118e24-24a3-449f-9e86-8a647f760f24 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:24.852258 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-69a281a1-b019-491b-b899-9ce2ed848ce1 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96e9a9e40c54b6a9a7f8560e4846be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef52881d75f407a942bf960230ea22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:24.856595 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-05118e24-24a3-449f-9e86-8a647f760f24 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1363 microversion: 2.1 time: 0.222507 Jul 28 18:13:24.857325 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 68/129] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:24 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1363 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:13:24.861793 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-69a281a1-b019-491b-b899-9ce2ed848ce1 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436" status: 200 len: 1314 microversion: 2.1 time: 0.254366 Jul 28 18:13:24.862010 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-b364a5fe-7fa6-471a-9f8d-6e9b78c8bc90 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:24.862506 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 62/130] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:24 2022] GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:24.862634 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-b364a5fe-7fa6-471a-9f8d-6e9b78c8bc90 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:24.868519 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b364a5fe-7fa6-471a-9f8d-6e9b78c8bc90 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:24.869015 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b364a5fe-7fa6-471a-9f8d-6e9b78c8bc90 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:24.870200 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b364a5fe-7fa6-471a-9f8d-6e9b78c8bc90 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:24.871006 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b364a5fe-7fa6-471a-9f8d-6e9b78c8bc90 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:24.876245 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-4f329889-8b68-428e-9e47-43e9e2a96e34 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:24.876953 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-4f329889-8b68-428e-9e47-43e9e2a96e34 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:24.883577 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4f329889-8b68-428e-9e47-43e9e2a96e34 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:24.884112 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4f329889-8b68-428e-9e47-43e9e2a96e34 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:24.885091 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4f329889-8b68-428e-9e47-43e9e2a96e34 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:24.885467 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4f329889-8b68-428e-9e47-43e9e2a96e34 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:25.082140 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-b364a5fe-7fa6-471a-9f8d-6e9b78c8bc90 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:25.085972 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-4f329889-8b68-428e-9e47-43e9e2a96e34 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:25.089616 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-b364a5fe-7fa6-471a-9f8d-6e9b78c8bc90 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1322 microversion: 2.1 time: 0.231327 Jul 28 18:13:25.090197 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 69/131] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:24 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1322 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:25.094205 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-4f329889-8b68-428e-9e47-43e9e2a96e34 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:25.096584 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-4f329889-8b68-428e-9e47-43e9e2a96e34 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:25.097716 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-4f329889-8b68-428e-9e47-43e9e2a96e34 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1405 microversion: 2.20 time: 0.225869 Jul 28 18:13:25.098264 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 63/132] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:13:24 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1405 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:13:25.878779 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-0736fde5-4ce0-44f2-b89e-d010adefd6d0 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:25.880256 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-0736fde5-4ce0-44f2-b89e-d010adefd6d0 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:25.893067 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d78b0b48-fa82-4d0f-9d35-1569894a51d3 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:25.893067 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-d78b0b48-fa82-4d0f-9d35-1569894a51d3 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:25.893723 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d78b0b48-fa82-4d0f-9d35-1569894a51d3 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:25.893917 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d78b0b48-fa82-4d0f-9d35-1569894a51d3 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:25.894699 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d78b0b48-fa82-4d0f-9d35-1569894a51d3 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:25.895154 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d78b0b48-fa82-4d0f-9d35-1569894a51d3 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:25.900395 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-0736fde5-4ce0-44f2-b89e-d010adefd6d0 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:25.904615 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-0736fde5-4ce0-44f2-b89e-d010adefd6d0 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:25.904615 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-0736fde5-4ce0-44f2-b89e-d010adefd6d0 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:25.904615 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-0736fde5-4ce0-44f2-b89e-d010adefd6d0 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:26.138655 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-d78b0b48-fa82-4d0f-9d35-1569894a51d3 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96e9a9e40c54b6a9a7f8560e4846be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef52881d75f407a942bf960230ea22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:26.143100 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-0736fde5-4ce0-44f2-b89e-d010adefd6d0 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:26.151497 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-0736fde5-4ce0-44f2-b89e-d010adefd6d0 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1363 microversion: 2.1 time: 0.277406 Jul 28 18:13:26.152087 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 70/133] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:25 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1363 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:26.155271 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-d78b0b48-fa82-4d0f-9d35-1569894a51d3 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436" status: 200 len: 1314 microversion: 2.1 time: 0.275050 Jul 28 18:13:26.156085 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 64/134] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:25 2022] GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:26.161737 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-1d3987ad-f522-474d-9055-f9b02077df35 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:26.168479 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-1d3987ad-f522-474d-9055-f9b02077df35 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:26.168597 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-e5b24404-7748-483a-a47e-835f7b3f56b6 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:26.168597 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-e5b24404-7748-483a-a47e-835f7b3f56b6 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:26.168872 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1d3987ad-f522-474d-9055-f9b02077df35 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:26.169613 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1d3987ad-f522-474d-9055-f9b02077df35 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:26.170369 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e5b24404-7748-483a-a47e-835f7b3f56b6 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:26.170491 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1d3987ad-f522-474d-9055-f9b02077df35 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:26.170820 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e5b24404-7748-483a-a47e-835f7b3f56b6 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:26.171064 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1d3987ad-f522-474d-9055-f9b02077df35 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:26.171590 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e5b24404-7748-483a-a47e-835f7b3f56b6 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:26.172028 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e5b24404-7748-483a-a47e-835f7b3f56b6 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:26.369910 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-1d3987ad-f522-474d-9055-f9b02077df35 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:26.377052 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-e5b24404-7748-483a-a47e-835f7b3f56b6 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:26.378932 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-1d3987ad-f522-474d-9055-f9b02077df35 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:26.380651 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-1d3987ad-f522-474d-9055-f9b02077df35 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:26.381994 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-1d3987ad-f522-474d-9055-f9b02077df35 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1405 microversion: 2.20 time: 0.224647 Jul 28 18:13:26.382781 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 65/135] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:13:26 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1405 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:13:26.388387 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-e5b24404-7748-483a-a47e-835f7b3f56b6 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1322 microversion: 2.1 time: 0.235039 Jul 28 18:13:26.389166 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 71/136] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:26 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:27.184248 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-99683e70-2294-407d-9366-499ba801f664 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:27.185054 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ca503a06-40e4-489c-8691-c78498b7e0df tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:27.185891 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-99683e70-2294-407d-9366-499ba801f664 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:27.186920 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ca503a06-40e4-489c-8691-c78498b7e0df tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:27.199722 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ca503a06-40e4-489c-8691-c78498b7e0df tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:27.200522 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-99683e70-2294-407d-9366-499ba801f664 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:27.200989 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-99683e70-2294-407d-9366-499ba801f664 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:27.201955 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-99683e70-2294-407d-9366-499ba801f664 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:27.202535 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ca503a06-40e4-489c-8691-c78498b7e0df tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:27.203316 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ca503a06-40e4-489c-8691-c78498b7e0df tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:27.203918 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-99683e70-2294-407d-9366-499ba801f664 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:27.206809 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ca503a06-40e4-489c-8691-c78498b7e0df tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:27.446020 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-99683e70-2294-407d-9366-499ba801f664 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96e9a9e40c54b6a9a7f8560e4846be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef52881d75f407a942bf960230ea22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:27.456920 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-99683e70-2294-407d-9366-499ba801f664 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436" status: 200 len: 1314 microversion: 2.1 time: 0.283298 Jul 28 18:13:27.457566 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 72/137] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:27 2022] GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:27.462133 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [req-a6f22d2c-7a0e-4f7e-b056-0e2edf250bf6 req-365b6dba-faef-4d41-8e4c-8a35fe105c68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f8c8622-dfde-4eb5-95c4-7716aebf0fcd", "name": "network-vif-plugged", "status": "completed", "tag": "7d6f0f21-22dc-4e8d-82cd-162059368b29"}]} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:13:27.476214 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-a6f22d2c-7a0e-4f7e-b056-0e2edf250bf6 req-365b6dba-faef-4d41-8e4c-8a35fe105c68 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:27.477089 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-a6f22d2c-7a0e-4f7e-b056-0e2edf250bf6 req-365b6dba-faef-4d41-8e4c-8a35fe105c68 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:27.481740 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ca503a06-40e4-489c-8691-c78498b7e0df tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:27.495241 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.compute.server_external_events [req-a6f22d2c-7a0e-4f7e-b056-0e2edf250bf6 req-365b6dba-faef-4d41-8e4c-8a35fe105c68 service nova] Creating event network-vif-plugged:7d6f0f21-22dc-4e8d-82cd-162059368b29 for instance 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd on hv-cinder-84617 Jul 28 18:13:27.495607 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ca503a06-40e4-489c-8691-c78498b7e0df tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1363 microversion: 2.1 time: 0.325330 Jul 28 18:13:27.496745 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 66/138] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:27 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1363 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:27.502165 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [req-a6f22d2c-7a0e-4f7e-b056-0e2edf250bf6 req-365b6dba-faef-4d41-8e4c-8a35fe105c68 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043216 Jul 28 18:13:27.503606 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ea67d802-4a1e-4a75-82cf-eed57db8e1d4 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:27.503797 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 73/139] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:13:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:13:27.504539 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ea67d802-4a1e-4a75-82cf-eed57db8e1d4 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:27.509135 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-c33be659-4871-4fa4-963a-ead3b48884ce tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:27.510175 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-c33be659-4871-4fa4-963a-ead3b48884ce tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:27.512714 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ea67d802-4a1e-4a75-82cf-eed57db8e1d4 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:27.513304 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ea67d802-4a1e-4a75-82cf-eed57db8e1d4 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:27.514521 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ea67d802-4a1e-4a75-82cf-eed57db8e1d4 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:27.514972 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ea67d802-4a1e-4a75-82cf-eed57db8e1d4 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:27.517421 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c33be659-4871-4fa4-963a-ead3b48884ce tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:27.518293 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c33be659-4871-4fa4-963a-ead3b48884ce tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:27.519305 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c33be659-4871-4fa4-963a-ead3b48884ce tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:27.521353 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c33be659-4871-4fa4-963a-ead3b48884ce tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:27.989457 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ea67d802-4a1e-4a75-82cf-eed57db8e1d4 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:27.994998 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-c33be659-4871-4fa4-963a-ead3b48884ce tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:28.005199 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-c33be659-4871-4fa4-963a-ead3b48884ce tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1322 microversion: 2.1 time: 0.499858 Jul 28 18:13:28.006513 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 74/140] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:27 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1322 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:28.009069 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ea67d802-4a1e-4a75-82cf-eed57db8e1d4 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:28.011271 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ea67d802-4a1e-4a75-82cf-eed57db8e1d4 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:28.014309 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ea67d802-4a1e-4a75-82cf-eed57db8e1d4 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1405 microversion: 2.20 time: 0.515647 Jul 28 18:13:28.015109 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 67/141] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:13:27 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1405 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:13:28.479614 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-a53701cf-6b34-4299-85ad-7dbf6c375df7 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:28.480223 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-a53701cf-6b34-4299-85ad-7dbf6c375df7 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:28.486983 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a53701cf-6b34-4299-85ad-7dbf6c375df7 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:28.488024 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a53701cf-6b34-4299-85ad-7dbf6c375df7 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:28.488836 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a53701cf-6b34-4299-85ad-7dbf6c375df7 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:28.489505 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a53701cf-6b34-4299-85ad-7dbf6c375df7 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:28.519684 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-bea8bc22-27a0-47c5-9850-2156182e4a3d tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:28.520883 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-bea8bc22-27a0-47c5-9850-2156182e4a3d tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:28.530417 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bea8bc22-27a0-47c5-9850-2156182e4a3d tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:28.531492 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bea8bc22-27a0-47c5-9850-2156182e4a3d tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:28.532749 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bea8bc22-27a0-47c5-9850-2156182e4a3d tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:28.534023 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bea8bc22-27a0-47c5-9850-2156182e4a3d tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:28.738267 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-a53701cf-6b34-4299-85ad-7dbf6c375df7 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96e9a9e40c54b6a9a7f8560e4846be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef52881d75f407a942bf960230ea22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:28.754340 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-a53701cf-6b34-4299-85ad-7dbf6c375df7 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436" status: 200 len: 1314 microversion: 2.1 time: 0.278273 Jul 28 18:13:28.754929 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 75/142] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:28 2022] GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:28.977202 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-bea8bc22-27a0-47c5-9850-2156182e4a3d tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:28.985157 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-bea8bc22-27a0-47c5-9850-2156182e4a3d tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1363 microversion: 2.1 time: 0.471296 Jul 28 18:13:28.987302 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 68/143] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:28 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1363 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:13:29.027673 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-ba67ac01-7cd8-4779-b316-b5a1beef7913 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:29.028646 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-ba67ac01-7cd8-4779-b316-b5a1beef7913 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:29.036999 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ba67ac01-7cd8-4779-b316-b5a1beef7913 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:29.037206 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-7d765b21-2d79-452a-a565-d3bd78cd6456 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:29.037457 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ba67ac01-7cd8-4779-b316-b5a1beef7913 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:29.037717 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-7d765b21-2d79-452a-a565-d3bd78cd6456 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:29.038246 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ba67ac01-7cd8-4779-b316-b5a1beef7913 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:29.038689 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ba67ac01-7cd8-4779-b316-b5a1beef7913 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:29.047415 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7d765b21-2d79-452a-a565-d3bd78cd6456 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:29.047866 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7d765b21-2d79-452a-a565-d3bd78cd6456 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:29.048650 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7d765b21-2d79-452a-a565-d3bd78cd6456 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:29.052789 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7d765b21-2d79-452a-a565-d3bd78cd6456 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:29.492842 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-7d765b21-2d79-452a-a565-d3bd78cd6456 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:29.509795 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-7d765b21-2d79-452a-a565-d3bd78cd6456 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:29.509795 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-7d765b21-2d79-452a-a565-d3bd78cd6456 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:29.510038 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-ba67ac01-7cd8-4779-b316-b5a1beef7913 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:29.510502 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-7d765b21-2d79-452a-a565-d3bd78cd6456 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1405 microversion: 2.20 time: 0.475357 Jul 28 18:13:29.510502 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 69/144] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:13:29 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1405 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:13:29.515355 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-ba67ac01-7cd8-4779-b316-b5a1beef7913 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1322 microversion: 2.1 time: 0.492353 Jul 28 18:13:29.516057 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 76/145] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:29 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1322 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:29.779805 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ca3340ed-a5ec-46bc-b5cb-2eace67cef9c tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:29.780423 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ca3340ed-a5ec-46bc-b5cb-2eace67cef9c tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:29.787832 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ca3340ed-a5ec-46bc-b5cb-2eace67cef9c tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:29.788356 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ca3340ed-a5ec-46bc-b5cb-2eace67cef9c tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:29.789243 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ca3340ed-a5ec-46bc-b5cb-2eace67cef9c tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:29.789791 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ca3340ed-a5ec-46bc-b5cb-2eace67cef9c tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:29.991071 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ca3340ed-a5ec-46bc-b5cb-2eace67cef9c tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96e9a9e40c54b6a9a7f8560e4846be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef52881d75f407a942bf960230ea22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:29.998542 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ca3340ed-a5ec-46bc-b5cb-2eace67cef9c tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436" status: 200 len: 1314 microversion: 2.1 time: 0.224649 Jul 28 18:13:29.999152 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 70/146] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:29 2022] GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:13:30.009990 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-a67cf7f5-eb94-4220-a05e-e07d61391dc3 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:30.011216 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-a67cf7f5-eb94-4220-a05e-e07d61391dc3 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:30.017106 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_api:SELECT=100 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:13:30.022405 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a67cf7f5-eb94-4220-a05e-e07d61391dc3 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:30.022939 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a67cf7f5-eb94-4220-a05e-e07d61391dc3 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:30.023753 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a67cf7f5-eb94-4220-a05e-e07d61391dc3 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:30.024204 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a67cf7f5-eb94-4220-a05e-e07d61391dc3 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:30.179915 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-a67cf7f5-eb94-4220-a05e-e07d61391dc3 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:30.193484 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-a67cf7f5-eb94-4220-a05e-e07d61391dc3 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1363 microversion: 2.1 time: 0.186354 Jul 28 18:13:30.194109 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 77/147] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:30 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:30.531278 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-8a879547-b29d-4790-bd4d-b86ab0c354a8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:30.531970 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-8a879547-b29d-4790-bd4d-b86ab0c354a8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:30.538328 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8a879547-b29d-4790-bd4d-b86ab0c354a8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:30.538781 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8a879547-b29d-4790-bd4d-b86ab0c354a8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:30.539570 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8a879547-b29d-4790-bd4d-b86ab0c354a8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:30.539992 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8a879547-b29d-4790-bd4d-b86ab0c354a8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:30.540251 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-d16b3cd6-4343-4205-8956-d833aa27bb92 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:30.540881 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-d16b3cd6-4343-4205-8956-d833aa27bb92 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:30.547236 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d16b3cd6-4343-4205-8956-d833aa27bb92 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:30.547687 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d16b3cd6-4343-4205-8956-d833aa27bb92 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:30.548771 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d16b3cd6-4343-4205-8956-d833aa27bb92 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:30.549243 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d16b3cd6-4343-4205-8956-d833aa27bb92 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:30.737910 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8a879547-b29d-4790-bd4d-b86ab0c354a8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:30.744697 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-d16b3cd6-4343-4205-8956-d833aa27bb92 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:30.746709 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8a879547-b29d-4790-bd4d-b86ab0c354a8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:30.748424 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8a879547-b29d-4790-bd4d-b86ab0c354a8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:30.749721 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-8a879547-b29d-4790-bd4d-b86ab0c354a8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1405 microversion: 2.20 time: 0.222286 Jul 28 18:13:30.750276 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 71/148] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:13:30 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1405 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:13:30.752690 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-d16b3cd6-4343-4205-8956-d833aa27bb92 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1322 microversion: 2.1 time: 0.219303 Jul 28 18:13:30.753292 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 78/149] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:30 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:13:31.019781 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-51a99d8c-bada-45fd-beb0-b51d2b8b62d1 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:31.020397 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-51a99d8c-bada-45fd-beb0-b51d2b8b62d1 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:31.026522 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-51a99d8c-bada-45fd-beb0-b51d2b8b62d1 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:31.026970 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-51a99d8c-bada-45fd-beb0-b51d2b8b62d1 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:31.027729 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-51a99d8c-bada-45fd-beb0-b51d2b8b62d1 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:31.028167 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-51a99d8c-bada-45fd-beb0-b51d2b8b62d1 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:31.167278 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-51a99d8c-bada-45fd-beb0-b51d2b8b62d1 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96e9a9e40c54b6a9a7f8560e4846be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef52881d75f407a942bf960230ea22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:31.182627 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-51a99d8c-bada-45fd-beb0-b51d2b8b62d1 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436" status: 200 len: 1314 microversion: 2.1 time: 0.166625 Jul 28 18:13:31.183203 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 72/150] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:31 2022] GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:31.219645 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-e6ceb8c8-f157-4731-b2d6-f4994da3a043 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:31.220258 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-e6ceb8c8-f157-4731-b2d6-f4994da3a043 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:31.226543 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e6ceb8c8-f157-4731-b2d6-f4994da3a043 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:31.227033 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e6ceb8c8-f157-4731-b2d6-f4994da3a043 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:31.227810 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e6ceb8c8-f157-4731-b2d6-f4994da3a043 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:31.228255 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e6ceb8c8-f157-4731-b2d6-f4994da3a043 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:31.361731 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-e6ceb8c8-f157-4731-b2d6-f4994da3a043 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:31.369708 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-e6ceb8c8-f157-4731-b2d6-f4994da3a043 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1363 microversion: 2.1 time: 0.154007 Jul 28 18:13:31.370330 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 79/151] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:31 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:31.772978 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3c610304-e005-4b6f-9aac-4764052ce53a tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:31.773777 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3c610304-e005-4b6f-9aac-4764052ce53a tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:31.776423 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-0ff4087b-7d72-4208-9744-b91b9a7472e2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:31.777059 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-0ff4087b-7d72-4208-9744-b91b9a7472e2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:31.780115 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3c610304-e005-4b6f-9aac-4764052ce53a tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:31.780570 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3c610304-e005-4b6f-9aac-4764052ce53a tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:31.781406 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3c610304-e005-4b6f-9aac-4764052ce53a tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:31.782022 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3c610304-e005-4b6f-9aac-4764052ce53a tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:31.783012 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-0ff4087b-7d72-4208-9744-b91b9a7472e2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:31.783558 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-0ff4087b-7d72-4208-9744-b91b9a7472e2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:31.784314 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-0ff4087b-7d72-4208-9744-b91b9a7472e2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:31.784744 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-0ff4087b-7d72-4208-9744-b91b9a7472e2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:31.970174 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-0ff4087b-7d72-4208-9744-b91b9a7472e2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:31.978842 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-0ff4087b-7d72-4208-9744-b91b9a7472e2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:31.980357 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-0ff4087b-7d72-4208-9744-b91b9a7472e2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:31.981538 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-0ff4087b-7d72-4208-9744-b91b9a7472e2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1405 microversion: 2.20 time: 0.208912 Jul 28 18:13:31.982113 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 80/152] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:13:31 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1405 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:13:31.982244 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-3c610304-e005-4b6f-9aac-4764052ce53a tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:31.990534 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-3c610304-e005-4b6f-9aac-4764052ce53a tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1322 microversion: 2.1 time: 0.221561 Jul 28 18:13:31.991086 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 73/153] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:31 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:32.203524 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-832d0747-b148-4668-912c-8bbc3897dda8 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:32.204280 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-832d0747-b148-4668-912c-8bbc3897dda8 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:32.210213 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-832d0747-b148-4668-912c-8bbc3897dda8 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:32.212144 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-832d0747-b148-4668-912c-8bbc3897dda8 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:32.212144 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-832d0747-b148-4668-912c-8bbc3897dda8 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:32.212144 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-832d0747-b148-4668-912c-8bbc3897dda8 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:32.344228 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-832d0747-b148-4668-912c-8bbc3897dda8 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96e9a9e40c54b6a9a7f8560e4846be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef52881d75f407a942bf960230ea22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:32.352551 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-832d0747-b148-4668-912c-8bbc3897dda8 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436" status: 200 len: 1314 microversion: 2.1 time: 0.152918 Jul 28 18:13:32.353257 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 81/154] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:32 2022] GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:32.390744 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-bdede410-9998-4528-9e85-6a0b1cbbdea3 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:32.391347 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-bdede410-9998-4528-9e85-6a0b1cbbdea3 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:32.393758 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:13:32.398637 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bdede410-9998-4528-9e85-6a0b1cbbdea3 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:32.399101 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bdede410-9998-4528-9e85-6a0b1cbbdea3 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:32.399856 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bdede410-9998-4528-9e85-6a0b1cbbdea3 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:32.400293 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bdede410-9998-4528-9e85-6a0b1cbbdea3 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:32.527029 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-bdede410-9998-4528-9e85-6a0b1cbbdea3 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:32.534984 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-bdede410-9998-4528-9e85-6a0b1cbbdea3 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1363 microversion: 2.1 time: 0.148084 Jul 28 18:13:32.535548 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 74/155] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:32 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:33.005402 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-843989d9-4f45-478d-841c-da4b761ec1bd tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:33.005997 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-843989d9-4f45-478d-841c-da4b761ec1bd tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:33.011664 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-9551c783-1180-45d6-8b90-0f277ff18b52 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:33.012099 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-843989d9-4f45-478d-841c-da4b761ec1bd tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:33.012267 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-9551c783-1180-45d6-8b90-0f277ff18b52 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:33.012553 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-843989d9-4f45-478d-841c-da4b761ec1bd tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:33.013407 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-843989d9-4f45-478d-841c-da4b761ec1bd tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:33.013845 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-843989d9-4f45-478d-841c-da4b761ec1bd tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:33.019637 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9551c783-1180-45d6-8b90-0f277ff18b52 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:33.020107 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9551c783-1180-45d6-8b90-0f277ff18b52 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:33.020898 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9551c783-1180-45d6-8b90-0f277ff18b52 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:33.021355 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9551c783-1180-45d6-8b90-0f277ff18b52 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:33.202820 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-843989d9-4f45-478d-841c-da4b761ec1bd tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:33.210987 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-843989d9-4f45-478d-841c-da4b761ec1bd tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:33.212655 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-843989d9-4f45-478d-841c-da4b761ec1bd tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:33.213885 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-843989d9-4f45-478d-841c-da4b761ec1bd tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1405 microversion: 2.20 time: 0.213502 Jul 28 18:13:33.218875 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-9551c783-1180-45d6-8b90-0f277ff18b52 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:33.219017 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 82/156] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:13:32 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1405 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:13:33.219123 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:13:33.222665 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-9551c783-1180-45d6-8b90-0f277ff18b52 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1322 microversion: 2.1 time: 0.214907 Jul 28 18:13:33.223230 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 75/157] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:33 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:13:33.372924 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-8508497c-cb89-4d99-81ed-36a2898fba2c tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:33.373557 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-8508497c-cb89-4d99-81ed-36a2898fba2c tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:33.380213 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-8508497c-cb89-4d99-81ed-36a2898fba2c tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:33.380664 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-8508497c-cb89-4d99-81ed-36a2898fba2c tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:33.381460 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-8508497c-cb89-4d99-81ed-36a2898fba2c tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:33.381902 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-8508497c-cb89-4d99-81ed-36a2898fba2c tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:33.385851 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell1:SELECT=100 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:13:33.516606 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-8508497c-cb89-4d99-81ed-36a2898fba2c tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96e9a9e40c54b6a9a7f8560e4846be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef52881d75f407a942bf960230ea22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:33.521878 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-8508497c-cb89-4d99-81ed-36a2898fba2c tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436" status: 200 len: 1314 microversion: 2.1 time: 0.152765 Jul 28 18:13:33.522439 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 83/158] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:33 2022] GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:33.556178 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-180a0bb0-e7dc-4578-b392-76b6fb86f36b tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:33.556787 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-180a0bb0-e7dc-4578-b392-76b6fb86f36b tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:33.563000 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-180a0bb0-e7dc-4578-b392-76b6fb86f36b tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:33.563458 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-180a0bb0-e7dc-4578-b392-76b6fb86f36b tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:33.564222 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-180a0bb0-e7dc-4578-b392-76b6fb86f36b tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:33.564661 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-180a0bb0-e7dc-4578-b392-76b6fb86f36b tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:33.693075 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-180a0bb0-e7dc-4578-b392-76b6fb86f36b tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:33.700704 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-180a0bb0-e7dc-4578-b392-76b6fb86f36b tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1363 microversion: 2.1 time: 0.148668 Jul 28 18:13:33.701316 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 76/159] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:33 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:34.237822 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-2dd60d41-842e-4f24-97ce-17caf3750a2d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:34.237822 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-2dd60d41-842e-4f24-97ce-17caf3750a2d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:34.243535 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2dd60d41-842e-4f24-97ce-17caf3750a2d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:34.243996 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2dd60d41-842e-4f24-97ce-17caf3750a2d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:34.244664 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b1de5938-dc6d-4e97-8336-83a8a5ec0811 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:34.244789 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2dd60d41-842e-4f24-97ce-17caf3750a2d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:34.245236 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2dd60d41-842e-4f24-97ce-17caf3750a2d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:34.248365 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b1de5938-dc6d-4e97-8336-83a8a5ec0811 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:34.252337 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b1de5938-dc6d-4e97-8336-83a8a5ec0811 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:34.252910 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b1de5938-dc6d-4e97-8336-83a8a5ec0811 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:34.253776 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b1de5938-dc6d-4e97-8336-83a8a5ec0811 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:34.254220 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b1de5938-dc6d-4e97-8336-83a8a5ec0811 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:34.445352 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-2dd60d41-842e-4f24-97ce-17caf3750a2d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:34.448636 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b1de5938-dc6d-4e97-8336-83a8a5ec0811 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:34.453718 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-2dd60d41-842e-4f24-97ce-17caf3750a2d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:34.458739 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-2dd60d41-842e-4f24-97ce-17caf3750a2d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:34.458878 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b1de5938-dc6d-4e97-8336-83a8a5ec0811 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1322 microversion: 2.1 time: 0.216922 Jul 28 18:13:34.458982 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-2dd60d41-842e-4f24-97ce-17caf3750a2d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1405 microversion: 2.20 time: 0.224816 Jul 28 18:13:34.459076 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 77/160] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:34 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:34.459183 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 84/161] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:13:34 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1405 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:13:34.542820 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-68a76529-fac5-4d5b-a274-e02cfe27ceef tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:34.543430 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-68a76529-fac5-4d5b-a274-e02cfe27ceef tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:34.549430 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-68a76529-fac5-4d5b-a274-e02cfe27ceef tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:34.549881 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-68a76529-fac5-4d5b-a274-e02cfe27ceef tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:34.550644 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-68a76529-fac5-4d5b-a274-e02cfe27ceef tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:34.551087 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-68a76529-fac5-4d5b-a274-e02cfe27ceef tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:34.701052 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-68a76529-fac5-4d5b-a274-e02cfe27ceef tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96e9a9e40c54b6a9a7f8560e4846be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef52881d75f407a942bf960230ea22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:34.709205 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-68a76529-fac5-4d5b-a274-e02cfe27ceef tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436" status: 200 len: 1314 microversion: 2.1 time: 0.170181 Jul 28 18:13:34.709776 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 78/162] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:34 2022] GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:34.723324 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-d54c4cb0-0614-4d06-9ad0-202a32ba1216 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:34.723985 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-d54c4cb0-0614-4d06-9ad0-202a32ba1216 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:34.733841 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d54c4cb0-0614-4d06-9ad0-202a32ba1216 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:34.733841 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d54c4cb0-0614-4d06-9ad0-202a32ba1216 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:34.733841 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d54c4cb0-0614-4d06-9ad0-202a32ba1216 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:34.733841 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d54c4cb0-0614-4d06-9ad0-202a32ba1216 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:34.900312 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-d54c4cb0-0614-4d06-9ad0-202a32ba1216 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:34.900312 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-d54c4cb0-0614-4d06-9ad0-202a32ba1216 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1363 microversion: 2.1 time: 0.160427 Jul 28 18:13:34.900312 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 85/163] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:34 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:35.481224 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-157b8d67-1585-40a1-8d7e-871c7277f3fc tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:35.481953 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-64749a77-7154-4b67-8b09-015bba20de57 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:35.482075 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-157b8d67-1585-40a1-8d7e-871c7277f3fc tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:35.482490 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-64749a77-7154-4b67-8b09-015bba20de57 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:35.488620 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-157b8d67-1585-40a1-8d7e-871c7277f3fc tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:35.489024 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-64749a77-7154-4b67-8b09-015bba20de57 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:35.489155 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-157b8d67-1585-40a1-8d7e-871c7277f3fc tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:35.489476 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-64749a77-7154-4b67-8b09-015bba20de57 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:35.490335 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-157b8d67-1585-40a1-8d7e-871c7277f3fc tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:35.490481 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-64749a77-7154-4b67-8b09-015bba20de57 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:35.490773 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-157b8d67-1585-40a1-8d7e-871c7277f3fc tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:35.490902 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-64749a77-7154-4b67-8b09-015bba20de57 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:35.682076 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-157b8d67-1585-40a1-8d7e-871c7277f3fc tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:35.687626 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-157b8d67-1585-40a1-8d7e-871c7277f3fc tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:35.689163 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-157b8d67-1585-40a1-8d7e-871c7277f3fc tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:35.690291 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-157b8d67-1585-40a1-8d7e-871c7277f3fc tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1405 microversion: 2.20 time: 0.213930 Jul 28 18:13:35.690831 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-64749a77-7154-4b67-8b09-015bba20de57 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:35.691291 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 86/164] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:13:35 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1405 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:13:35.698333 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-64749a77-7154-4b67-8b09-015bba20de57 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1322 microversion: 2.1 time: 0.224669 Jul 28 18:13:35.698893 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 79/165] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:35 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:35.729827 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-28109f35-1da8-499c-851d-51f75b00906e tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:35.730366 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-28109f35-1da8-499c-851d-51f75b00906e tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:35.737387 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-28109f35-1da8-499c-851d-51f75b00906e tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:35.737754 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-28109f35-1da8-499c-851d-51f75b00906e tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:35.738501 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-28109f35-1da8-499c-851d-51f75b00906e tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:35.738944 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-28109f35-1da8-499c-851d-51f75b00906e tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:35.872479 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-28109f35-1da8-499c-851d-51f75b00906e tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96e9a9e40c54b6a9a7f8560e4846be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef52881d75f407a942bf960230ea22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:35.880115 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-28109f35-1da8-499c-851d-51f75b00906e tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436" status: 200 len: 1314 microversion: 2.1 time: 0.154027 Jul 28 18:13:35.880686 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 87/166] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:35 2022] GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:35.901461 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-cea4b154-6810-4971-8865-b2bf5eb9eed1 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:35.902132 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-cea4b154-6810-4971-8865-b2bf5eb9eed1 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:35.908212 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cea4b154-6810-4971-8865-b2bf5eb9eed1 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:35.909332 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cea4b154-6810-4971-8865-b2bf5eb9eed1 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:35.910097 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cea4b154-6810-4971-8865-b2bf5eb9eed1 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:35.910534 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cea4b154-6810-4971-8865-b2bf5eb9eed1 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:36.039515 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-cea4b154-6810-4971-8865-b2bf5eb9eed1 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:36.046768 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-cea4b154-6810-4971-8865-b2bf5eb9eed1 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1363 microversion: 2.1 time: 0.150045 Jul 28 18:13:36.047327 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 80/167] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:35 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:36.712260 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-ef95bdc4-e378-4753-b98c-e9c41ea70871 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:36.712845 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-ef95bdc4-e378-4753-b98c-e9c41ea70871 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:36.718717 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ac3ea89f-96a5-452c-996a-de2f24e6e828 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:36.719328 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ac3ea89f-96a5-452c-996a-de2f24e6e828 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:36.719572 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ef95bdc4-e378-4753-b98c-e9c41ea70871 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:36.720020 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ef95bdc4-e378-4753-b98c-e9c41ea70871 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:36.720894 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ef95bdc4-e378-4753-b98c-e9c41ea70871 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:36.721293 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ef95bdc4-e378-4753-b98c-e9c41ea70871 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:36.725598 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ac3ea89f-96a5-452c-996a-de2f24e6e828 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:36.732250 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ac3ea89f-96a5-452c-996a-de2f24e6e828 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:36.732250 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ac3ea89f-96a5-452c-996a-de2f24e6e828 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:36.732250 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ac3ea89f-96a5-452c-996a-de2f24e6e828 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:36.923716 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-ef95bdc4-e378-4753-b98c-e9c41ea70871 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:36.923888 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ac3ea89f-96a5-452c-996a-de2f24e6e828 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:36.932536 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-ef95bdc4-e378-4753-b98c-e9c41ea70871 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:36.933151 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ac3ea89f-96a5-452c-996a-de2f24e6e828 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1322 microversion: 2.1 time: 0.218514 Jul 28 18:13:36.933726 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 81/168] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:36 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:13:36.937011 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-ef95bdc4-e378-4753-b98c-e9c41ea70871 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:36.937011 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-ef95bdc4-e378-4753-b98c-e9c41ea70871 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1405 microversion: 2.20 time: 0.227000 Jul 28 18:13:36.937011 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 88/169] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:13:36 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1405 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:13:36.940858 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0d271c35-e163-41c2-a77c-7b489adc54ee tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:36.941571 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0d271c35-e163-41c2-a77c-7b489adc54ee tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:36.947354 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0d271c35-e163-41c2-a77c-7b489adc54ee tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:36.947807 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0d271c35-e163-41c2-a77c-7b489adc54ee tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:36.948566 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0d271c35-e163-41c2-a77c-7b489adc54ee tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:36.949030 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0d271c35-e163-41c2-a77c-7b489adc54ee tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:37.068046 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-000da486-9339-4ba0-9dbd-34636f5f4117 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:37.068575 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-000da486-9339-4ba0-9dbd-34636f5f4117 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:37.074385 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-0d271c35-e163-41c2-a77c-7b489adc54ee tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96e9a9e40c54b6a9a7f8560e4846be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef52881d75f407a942bf960230ea22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:37.074696 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-000da486-9339-4ba0-9dbd-34636f5f4117 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:37.075150 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-000da486-9339-4ba0-9dbd-34636f5f4117 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:37.075927 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-000da486-9339-4ba0-9dbd-34636f5f4117 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:37.076365 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-000da486-9339-4ba0-9dbd-34636f5f4117 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:37.082181 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0d271c35-e163-41c2-a77c-7b489adc54ee tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436" status: 200 len: 1314 microversion: 2.1 time: 0.147516 Jul 28 18:13:37.082828 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 82/170] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:36 2022] GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:37.211051 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-000da486-9339-4ba0-9dbd-34636f5f4117 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:37.218844 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-000da486-9339-4ba0-9dbd-34636f5f4117 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1363 microversion: 2.1 time: 0.155372 Jul 28 18:13:37.219414 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 89/171] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:37 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:13:37.954262 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-663fe647-d694-4842-8975-0f4a896916fe tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:37.954971 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-663fe647-d694-4842-8975-0f4a896916fe tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:37.957808 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-8f6638cc-894f-4c00-91b4-a030f797c12b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:37.958509 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-8f6638cc-894f-4c00-91b4-a030f797c12b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:37.961072 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-663fe647-d694-4842-8975-0f4a896916fe tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:37.961525 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-663fe647-d694-4842-8975-0f4a896916fe tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:37.962317 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-663fe647-d694-4842-8975-0f4a896916fe tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:37.962754 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-663fe647-d694-4842-8975-0f4a896916fe tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:37.964418 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-8f6638cc-894f-4c00-91b4-a030f797c12b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:37.964872 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-8f6638cc-894f-4c00-91b4-a030f797c12b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:37.965696 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-8f6638cc-894f-4c00-91b4-a030f797c12b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:37.966141 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-8f6638cc-894f-4c00-91b4-a030f797c12b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:38.152061 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-663fe647-d694-4842-8975-0f4a896916fe tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:38.156045 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-8f6638cc-894f-4c00-91b4-a030f797c12b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:38.160062 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-663fe647-d694-4842-8975-0f4a896916fe tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1322 microversion: 2.1 time: 0.209620 Jul 28 18:13:38.160630 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 83/172] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:37 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:38.164941 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-8f6638cc-894f-4c00-91b4-a030f797c12b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:38.165123 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-43761653-c1bb-4041-81ef-46388715a60b tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:38.165570 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-43761653-c1bb-4041-81ef-46388715a60b tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:38.166644 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-8f6638cc-894f-4c00-91b4-a030f797c12b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:38.167940 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-8f6638cc-894f-4c00-91b4-a030f797c12b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1405 microversion: 2.20 time: 0.214183 Jul 28 18:13:38.168895 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 90/173] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:13:37 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1405 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:13:38.171560 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-43761653-c1bb-4041-81ef-46388715a60b tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:38.172005 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-43761653-c1bb-4041-81ef-46388715a60b tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:38.172754 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-43761653-c1bb-4041-81ef-46388715a60b tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:38.173207 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-43761653-c1bb-4041-81ef-46388715a60b tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:38.239762 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-887ee38e-9ec7-43d1-b958-34df9d6e3cd2 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:38.240273 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-887ee38e-9ec7-43d1-b958-34df9d6e3cd2 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:38.246325 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-887ee38e-9ec7-43d1-b958-34df9d6e3cd2 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:38.246773 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-887ee38e-9ec7-43d1-b958-34df9d6e3cd2 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:38.247564 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-887ee38e-9ec7-43d1-b958-34df9d6e3cd2 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:38.248022 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-887ee38e-9ec7-43d1-b958-34df9d6e3cd2 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:38.334971 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-43761653-c1bb-4041-81ef-46388715a60b tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96e9a9e40c54b6a9a7f8560e4846be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef52881d75f407a942bf960230ea22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:38.342483 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-43761653-c1bb-4041-81ef-46388715a60b tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436" status: 200 len: 1314 microversion: 2.1 time: 0.180879 Jul 28 18:13:38.343310 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 84/174] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:38 2022] GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:38.390757 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-887ee38e-9ec7-43d1-b958-34df9d6e3cd2 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:38.398487 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-887ee38e-9ec7-43d1-b958-34df9d6e3cd2 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1363 microversion: 2.1 time: 0.162603 Jul 28 18:13:38.399053 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 91/175] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:38 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:13:39.180304 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-c80d82b0-6467-41d3-83a1-786cec4cbcaa tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:39.180908 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-c80d82b0-6467-41d3-83a1-786cec4cbcaa tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:39.186985 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c80d82b0-6467-41d3-83a1-786cec4cbcaa tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:39.187465 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c80d82b0-6467-41d3-83a1-786cec4cbcaa tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:39.188217 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c80d82b0-6467-41d3-83a1-786cec4cbcaa tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:39.188649 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c80d82b0-6467-41d3-83a1-786cec4cbcaa tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:39.191262 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-851b5134-b090-4ade-a67a-88afa24e0a83 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:39.191877 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-851b5134-b090-4ade-a67a-88afa24e0a83 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:39.197826 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-851b5134-b090-4ade-a67a-88afa24e0a83 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:39.198277 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-851b5134-b090-4ade-a67a-88afa24e0a83 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:39.199050 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-851b5134-b090-4ade-a67a-88afa24e0a83 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:39.199489 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-851b5134-b090-4ade-a67a-88afa24e0a83 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:39.385101 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-c80d82b0-6467-41d3-83a1-786cec4cbcaa tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:39.388350 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-851b5134-b090-4ade-a67a-88afa24e0a83 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:39.392874 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-c80d82b0-6467-41d3-83a1-786cec4cbcaa tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1322 microversion: 2.1 time: 0.216357 Jul 28 18:13:39.394032 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 85/176] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:39 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:39.398173 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-851b5134-b090-4ade-a67a-88afa24e0a83 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:39.398844 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-e48ed8b8-1011-4289-96dc-8409fef8e887 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:39.399521 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-e48ed8b8-1011-4289-96dc-8409fef8e887 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:39.399897 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-851b5134-b090-4ade-a67a-88afa24e0a83 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:39.401140 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-851b5134-b090-4ade-a67a-88afa24e0a83 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1405 microversion: 2.20 time: 0.213956 Jul 28 18:13:39.401854 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 92/177] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:13:39 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1405 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:13:39.405708 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e48ed8b8-1011-4289-96dc-8409fef8e887 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:39.406267 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e48ed8b8-1011-4289-96dc-8409fef8e887 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:39.407117 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e48ed8b8-1011-4289-96dc-8409fef8e887 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:39.407623 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e48ed8b8-1011-4289-96dc-8409fef8e887 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:39.418872 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-7926dfc7-3d3c-4679-9dd3-6c94b0850df7 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:39.419706 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-7926dfc7-3d3c-4679-9dd3-6c94b0850df7 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:39.426542 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-7926dfc7-3d3c-4679-9dd3-6c94b0850df7 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:39.427356 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-7926dfc7-3d3c-4679-9dd3-6c94b0850df7 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:39.427868 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-7926dfc7-3d3c-4679-9dd3-6c94b0850df7 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:39.428311 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-7926dfc7-3d3c-4679-9dd3-6c94b0850df7 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:39.833250 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-e48ed8b8-1011-4289-96dc-8409fef8e887 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96e9a9e40c54b6a9a7f8560e4846be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef52881d75f407a942bf960230ea22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:39.841044 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-e48ed8b8-1011-4289-96dc-8409fef8e887 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436" status: 200 len: 1314 microversion: 2.1 time: 0.445890 Jul 28 18:13:39.842023 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 86/178] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:39 2022] GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 => generated 1314 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:39.843004 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-7926dfc7-3d3c-4679-9dd3-6c94b0850df7 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:39.850919 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-7926dfc7-3d3c-4679-9dd3-6c94b0850df7 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1363 microversion: 2.1 time: 0.435813 Jul 28 18:13:39.851481 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 93/179] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:39 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1363 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:40.415046 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-24c71e8b-d321-4a5b-acda-75a35ebbe140 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:40.415784 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-24c71e8b-d321-4a5b-acda-75a35ebbe140 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:40.423911 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-8c7434e2-cf5f-4a7c-a2de-046c7c907388 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:40.425157 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-8c7434e2-cf5f-4a7c-a2de-046c7c907388 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:40.430326 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-24c71e8b-d321-4a5b-acda-75a35ebbe140 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:40.430915 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-24c71e8b-d321-4a5b-acda-75a35ebbe140 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:40.431710 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-8c7434e2-cf5f-4a7c-a2de-046c7c907388 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:40.431710 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-8c7434e2-cf5f-4a7c-a2de-046c7c907388 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:40.431913 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-24c71e8b-d321-4a5b-acda-75a35ebbe140 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:40.432180 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-24c71e8b-d321-4a5b-acda-75a35ebbe140 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:40.432456 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-8c7434e2-cf5f-4a7c-a2de-046c7c907388 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:40.432896 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-8c7434e2-cf5f-4a7c-a2de-046c7c907388 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:40.645960 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-24c71e8b-d321-4a5b-acda-75a35ebbe140 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:40.655415 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-8c7434e2-cf5f-4a7c-a2de-046c7c907388 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:40.657412 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-24c71e8b-d321-4a5b-acda-75a35ebbe140 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1322 microversion: 2.1 time: 0.246950 Jul 28 18:13:40.665189 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-8c7434e2-cf5f-4a7c-a2de-046c7c907388 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:40.666898 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-8c7434e2-cf5f-4a7c-a2de-046c7c907388 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:40.668372 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-8c7434e2-cf5f-4a7c-a2de-046c7c907388 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1405 microversion: 2.20 time: 0.248362 Jul 28 18:13:40.669118 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 94/180] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:13:40 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1405 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:13:40.670293 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 87/181] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:40 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1322 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:40.682430 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [req-5551d892-49eb-46f3-b551-783f4c07304b req-0cef9b4f-7333-4950-a760-bc67fc99ec19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b1c63c9-4f4b-4c9e-91da-42f88fd63286", "name": "network-vif-plugged", "status": "completed", "tag": "1d258458-0cee-481c-93c4-bf0b858d9e28"}]} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:13:40.692122 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-5551d892-49eb-46f3-b551-783f4c07304b req-0cef9b4f-7333-4950-a760-bc67fc99ec19 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:40.692582 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-5551d892-49eb-46f3-b551-783f4c07304b req-0cef9b4f-7333-4950-a760-bc67fc99ec19 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:40.703434 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.compute.server_external_events [req-5551d892-49eb-46f3-b551-783f4c07304b req-0cef9b4f-7333-4950-a760-bc67fc99ec19 service nova] Creating event network-vif-plugged:1d258458-0cee-481c-93c4-bf0b858d9e28 for instance 2b1c63c9-4f4b-4c9e-91da-42f88fd63286 on hv-cinder-84617 Jul 28 18:13:40.709212 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [req-5551d892-49eb-46f3-b551-783f4c07304b req-0cef9b4f-7333-4950-a760-bc67fc99ec19 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030862 Jul 28 18:13:40.709796 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 95/182] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 18:13:40.862650 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-7721215e-8dde-4de1-825b-036d32b4d674 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:40.863253 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-7721215e-8dde-4de1-825b-036d32b4d674 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:40.871385 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7721215e-8dde-4de1-825b-036d32b4d674 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:40.872137 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7721215e-8dde-4de1-825b-036d32b4d674 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:40.875082 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7721215e-8dde-4de1-825b-036d32b4d674 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:40.875825 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7721215e-8dde-4de1-825b-036d32b4d674 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:40.876811 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-5909fae2-3377-4e72-ae07-45c401113c99 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:40.878292 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-5909fae2-3377-4e72-ae07-45c401113c99 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:40.885363 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-5909fae2-3377-4e72-ae07-45c401113c99 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:40.886258 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-5909fae2-3377-4e72-ae07-45c401113c99 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:40.887202 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-5909fae2-3377-4e72-ae07-45c401113c99 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:40.887651 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-5909fae2-3377-4e72-ae07-45c401113c99 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:41.095568 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-7721215e-8dde-4de1-825b-036d32b4d674 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96e9a9e40c54b6a9a7f8560e4846be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef52881d75f407a942bf960230ea22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:41.100276 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-5909fae2-3377-4e72-ae07-45c401113c99 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:41.103814 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-7721215e-8dde-4de1-825b-036d32b4d674 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436" status: 200 len: 1314 microversion: 2.1 time: 0.244946 Jul 28 18:13:41.104718 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 88/183] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:40 2022] GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:41.108377 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-5909fae2-3377-4e72-ae07-45c401113c99 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1363 microversion: 2.1 time: 0.240093 Jul 28 18:13:41.109150 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 96/184] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:40 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1363 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:41.679965 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-37ef3cdc-a9f5-4f4f-b2df-c62b4641a66e tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:41.680575 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-37ef3cdc-a9f5-4f4f-b2df-c62b4641a66e tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:41.688053 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-37ef3cdc-a9f5-4f4f-b2df-c62b4641a66e tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:41.688505 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-37ef3cdc-a9f5-4f4f-b2df-c62b4641a66e tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:41.689316 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-37ef3cdc-a9f5-4f4f-b2df-c62b4641a66e tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:41.689770 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-37ef3cdc-a9f5-4f4f-b2df-c62b4641a66e tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:41.691254 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-2f2b07e8-b3ec-4934-ac6f-8875fca33b48 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:41.691886 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-2f2b07e8-b3ec-4934-ac6f-8875fca33b48 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:41.698324 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2f2b07e8-b3ec-4934-ac6f-8875fca33b48 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:41.698778 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2f2b07e8-b3ec-4934-ac6f-8875fca33b48 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:41.709636 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2f2b07e8-b3ec-4934-ac6f-8875fca33b48 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:41.709636 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2f2b07e8-b3ec-4934-ac6f-8875fca33b48 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:41.887766 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-37ef3cdc-a9f5-4f4f-b2df-c62b4641a66e tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:41.895581 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-2f2b07e8-b3ec-4934-ac6f-8875fca33b48 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:41.895909 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-37ef3cdc-a9f5-4f4f-b2df-c62b4641a66e tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1322 microversion: 2.1 time: 0.219665 Jul 28 18:13:41.896502 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 89/185] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:41 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:41.903770 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-2f2b07e8-b3ec-4934-ac6f-8875fca33b48 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:41.905326 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-2f2b07e8-b3ec-4934-ac6f-8875fca33b48 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:41.906425 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-2f2b07e8-b3ec-4934-ac6f-8875fca33b48 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1405 microversion: 2.20 time: 0.219838 Jul 28 18:13:41.906972 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 97/186] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:13:41 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1405 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:13:42.124615 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-2b9a5be3-203c-45f2-b87f-62b20ff107e7 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:42.125253 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-2b9a5be3-203c-45f2-b87f-62b20ff107e7 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:42.128596 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-11e2f6a3-8004-4ef2-84e7-dcba55f0075b tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:42.129240 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-11e2f6a3-8004-4ef2-84e7-dcba55f0075b tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:42.131227 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2b9a5be3-203c-45f2-b87f-62b20ff107e7 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:42.131684 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2b9a5be3-203c-45f2-b87f-62b20ff107e7 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:42.132446 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2b9a5be3-203c-45f2-b87f-62b20ff107e7 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:42.132884 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2b9a5be3-203c-45f2-b87f-62b20ff107e7 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:42.135275 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-11e2f6a3-8004-4ef2-84e7-dcba55f0075b tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:42.135761 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-11e2f6a3-8004-4ef2-84e7-dcba55f0075b tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:42.136533 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-11e2f6a3-8004-4ef2-84e7-dcba55f0075b tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:42.137007 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-11e2f6a3-8004-4ef2-84e7-dcba55f0075b tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:42.322360 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-2b9a5be3-203c-45f2-b87f-62b20ff107e7 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96e9a9e40c54b6a9a7f8560e4846be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef52881d75f407a942bf960230ea22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:42.326222 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-11e2f6a3-8004-4ef2-84e7-dcba55f0075b tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:42.329908 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-2b9a5be3-203c-45f2-b87f-62b20ff107e7 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436" status: 200 len: 1314 microversion: 2.1 time: 0.209095 Jul 28 18:13:42.330979 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 90/187] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:42 2022] GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:42.334043 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-11e2f6a3-8004-4ef2-84e7-dcba55f0075b tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1363 microversion: 2.1 time: 0.209279 Jul 28 18:13:42.334594 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 98/188] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:42 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1363 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:13:42.916452 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-cbd21259-5bde-426a-ac6c-75e643fd6eaf tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:42.917101 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-cbd21259-5bde-426a-ac6c-75e643fd6eaf tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:42.923176 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cbd21259-5bde-426a-ac6c-75e643fd6eaf tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:42.923635 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cbd21259-5bde-426a-ac6c-75e643fd6eaf tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:42.925079 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cbd21259-5bde-426a-ac6c-75e643fd6eaf tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:42.925533 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cbd21259-5bde-426a-ac6c-75e643fd6eaf tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:42.929789 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-2aa6a4f7-4c16-4ff1-9256-1d3ed7df0a7b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:42.930397 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-2aa6a4f7-4c16-4ff1-9256-1d3ed7df0a7b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:42.936628 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2aa6a4f7-4c16-4ff1-9256-1d3ed7df0a7b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:42.937112 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2aa6a4f7-4c16-4ff1-9256-1d3ed7df0a7b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:42.937874 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2aa6a4f7-4c16-4ff1-9256-1d3ed7df0a7b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:42.938311 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2aa6a4f7-4c16-4ff1-9256-1d3ed7df0a7b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:43.130585 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-cbd21259-5bde-426a-ac6c-75e643fd6eaf tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:43.132931 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-2aa6a4f7-4c16-4ff1-9256-1d3ed7df0a7b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:43.137152 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-cbd21259-5bde-426a-ac6c-75e643fd6eaf tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1322 microversion: 2.1 time: 0.224516 Jul 28 18:13:43.137802 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 91/189] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:42 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:43.140916 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-2aa6a4f7-4c16-4ff1-9256-1d3ed7df0a7b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:43.142501 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-2aa6a4f7-4c16-4ff1-9256-1d3ed7df0a7b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:43.143603 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-2aa6a4f7-4c16-4ff1-9256-1d3ed7df0a7b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1405 microversion: 2.20 time: 0.217745 Jul 28 18:13:43.144147 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 99/190] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:13:42 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1405 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:13:43.351751 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-c7b08325-3bf1-478b-ae90-f57b6410a243 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:43.352656 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-c7b08325-3bf1-478b-ae90-f57b6410a243 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:43.355656 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-abd8e58b-fa28-4648-90b2-363d1c8ef959 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:43.356264 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-abd8e58b-fa28-4648-90b2-363d1c8ef959 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:43.358670 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c7b08325-3bf1-478b-ae90-f57b6410a243 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:43.359121 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c7b08325-3bf1-478b-ae90-f57b6410a243 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:43.359886 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c7b08325-3bf1-478b-ae90-f57b6410a243 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:43.360325 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c7b08325-3bf1-478b-ae90-f57b6410a243 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:43.362977 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-abd8e58b-fa28-4648-90b2-363d1c8ef959 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:43.363427 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-abd8e58b-fa28-4648-90b2-363d1c8ef959 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:43.364185 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-abd8e58b-fa28-4648-90b2-363d1c8ef959 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:43.364626 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-abd8e58b-fa28-4648-90b2-363d1c8ef959 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:43.375557 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:13:43.383070 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell1:SELECT=100 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:13:43.548363 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-abd8e58b-fa28-4648-90b2-363d1c8ef959 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:43.558082 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-abd8e58b-fa28-4648-90b2-363d1c8ef959 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1363 microversion: 2.1 time: 0.206476 Jul 28 18:13:43.558663 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 100/191] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:43 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1363 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:13:43.563043 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-c7b08325-3bf1-478b-ae90-f57b6410a243 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96e9a9e40c54b6a9a7f8560e4846be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef52881d75f407a942bf960230ea22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:43.570911 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-c7b08325-3bf1-478b-ae90-f57b6410a243 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436" status: 200 len: 1314 microversion: 2.1 time: 0.223034 Jul 28 18:13:43.571466 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 92/192] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:43 2022] GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:44.157433 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-f7028f49-149c-4f12-8408-27fb1194c6a9 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:44.158031 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-f7028f49-149c-4f12-8408-27fb1194c6a9 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:44.164187 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f7028f49-149c-4f12-8408-27fb1194c6a9 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:44.164646 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f7028f49-149c-4f12-8408-27fb1194c6a9 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:44.165451 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-26e0cb0d-e3b5-4eb4-aeb1-a64e01d01823 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:44.165842 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f7028f49-149c-4f12-8408-27fb1194c6a9 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:44.165934 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f7028f49-149c-4f12-8408-27fb1194c6a9 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:44.166084 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-26e0cb0d-e3b5-4eb4-aeb1-a64e01d01823 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:44.172138 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-26e0cb0d-e3b5-4eb4-aeb1-a64e01d01823 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:44.172585 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-26e0cb0d-e3b5-4eb4-aeb1-a64e01d01823 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:44.173372 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-26e0cb0d-e3b5-4eb4-aeb1-a64e01d01823 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:44.173807 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-26e0cb0d-e3b5-4eb4-aeb1-a64e01d01823 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:44.359370 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-f7028f49-149c-4f12-8408-27fb1194c6a9 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:44.363309 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-26e0cb0d-e3b5-4eb4-aeb1-a64e01d01823 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:44.367591 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-f7028f49-149c-4f12-8408-27fb1194c6a9 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1322 microversion: 2.1 time: 0.214064 Jul 28 18:13:44.368165 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 101/193] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:44 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:44.371901 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-26e0cb0d-e3b5-4eb4-aeb1-a64e01d01823 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:44.373450 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-26e0cb0d-e3b5-4eb4-aeb1-a64e01d01823 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:44.374540 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-26e0cb0d-e3b5-4eb4-aeb1-a64e01d01823 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1405 microversion: 2.20 time: 0.212946 Jul 28 18:13:44.375087 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 93/194] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:13:44 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1405 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:13:44.578670 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-f1f09410-11e8-4264-9557-e67419f83aff tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:44.579277 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-f1f09410-11e8-4264-9557-e67419f83aff tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:44.585560 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f1f09410-11e8-4264-9557-e67419f83aff tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:44.586011 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f1f09410-11e8-4264-9557-e67419f83aff tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:44.587068 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f1f09410-11e8-4264-9557-e67419f83aff tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:44.587508 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f1f09410-11e8-4264-9557-e67419f83aff tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:44.591520 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-fa423451-cf8f-44d6-8ef2-e4bd286a522c tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:44.592127 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-fa423451-cf8f-44d6-8ef2-e4bd286a522c tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:44.599233 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fa423451-cf8f-44d6-8ef2-e4bd286a522c tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:44.599674 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fa423451-cf8f-44d6-8ef2-e4bd286a522c tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:44.600439 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fa423451-cf8f-44d6-8ef2-e4bd286a522c tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:44.600881 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fa423451-cf8f-44d6-8ef2-e4bd286a522c tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:44.786122 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-f1f09410-11e8-4264-9557-e67419f83aff tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:44.790110 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-fa423451-cf8f-44d6-8ef2-e4bd286a522c tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96e9a9e40c54b6a9a7f8560e4846be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef52881d75f407a942bf960230ea22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:44.794903 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-f1f09410-11e8-4264-9557-e67419f83aff tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1363 microversion: 2.1 time: 0.219670 Jul 28 18:13:44.796027 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 102/195] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:44 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1363 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:44.799551 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-fa423451-cf8f-44d6-8ef2-e4bd286a522c tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436" status: 200 len: 1314 microversion: 2.1 time: 0.211765 Jul 28 18:13:44.800124 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 94/196] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:44 2022] GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:13:45.389384 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-4148dcbb-4393-490b-a154-ead610bc53e3 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:45.389898 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-4148dcbb-4393-490b-a154-ead610bc53e3 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:45.396683 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-4148dcbb-4393-490b-a154-ead610bc53e3 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:45.397332 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-4148dcbb-4393-490b-a154-ead610bc53e3 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:45.397927 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-4148dcbb-4393-490b-a154-ead610bc53e3 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:45.398364 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-4148dcbb-4393-490b-a154-ead610bc53e3 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:45.398499 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-665e9b00-90d3-402d-bae1-56fabbd77554 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:45.399106 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-665e9b00-90d3-402d-bae1-56fabbd77554 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:45.405500 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-665e9b00-90d3-402d-bae1-56fabbd77554 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:45.405942 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-665e9b00-90d3-402d-bae1-56fabbd77554 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:45.406713 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-665e9b00-90d3-402d-bae1-56fabbd77554 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:45.407149 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-665e9b00-90d3-402d-bae1-56fabbd77554 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:45.597883 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-4148dcbb-4393-490b-a154-ead610bc53e3 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:45.604644 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-665e9b00-90d3-402d-bae1-56fabbd77554 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:45.611934 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-4148dcbb-4393-490b-a154-ead610bc53e3 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1322 microversion: 2.1 time: 0.226656 Jul 28 18:13:45.612507 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 103/197] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:45 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1322 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:45.622168 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-665e9b00-90d3-402d-bae1-56fabbd77554 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:45.622168 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-665e9b00-90d3-402d-bae1-56fabbd77554 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:45.622168 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-665e9b00-90d3-402d-bae1-56fabbd77554 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1405 microversion: 2.20 time: 0.224154 Jul 28 18:13:45.622643 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 95/198] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:13:45 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1405 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:13:45.816637 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-6d81faac-da0e-4763-9bee-5a405e3e1fc3 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:45.817178 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-6d81faac-da0e-4763-9bee-5a405e3e1fc3 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:45.822098 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-25305443-031d-47cf-a928-e2cca23ae7f9 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:45.822790 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-25305443-031d-47cf-a928-e2cca23ae7f9 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:45.824000 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6d81faac-da0e-4763-9bee-5a405e3e1fc3 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:45.824804 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6d81faac-da0e-4763-9bee-5a405e3e1fc3 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:45.826265 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6d81faac-da0e-4763-9bee-5a405e3e1fc3 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:45.827063 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6d81faac-da0e-4763-9bee-5a405e3e1fc3 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:45.828727 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-25305443-031d-47cf-a928-e2cca23ae7f9 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:45.829415 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-25305443-031d-47cf-a928-e2cca23ae7f9 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:45.830365 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-25305443-031d-47cf-a928-e2cca23ae7f9 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:45.830820 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-25305443-031d-47cf-a928-e2cca23ae7f9 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:46.035503 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-6d81faac-da0e-4763-9bee-5a405e3e1fc3 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:46.040021 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-25305443-031d-47cf-a928-e2cca23ae7f9 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96e9a9e40c54b6a9a7f8560e4846be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef52881d75f407a942bf960230ea22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:46.043919 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-6d81faac-da0e-4763-9bee-5a405e3e1fc3 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1363 microversion: 2.1 time: 0.231146 Jul 28 18:13:46.044493 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 96/199] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:45 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1363 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:46.049572 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-25305443-031d-47cf-a928-e2cca23ae7f9 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436" status: 200 len: 1314 microversion: 2.1 time: 0.231624 Jul 28 18:13:46.050288 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 104/200] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:45 2022] GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:13:46.634248 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-beec1687-01db-465c-bd4b-ba1b7eae5be0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:46.637734 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-beec1687-01db-465c-bd4b-ba1b7eae5be0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:46.639633 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-619e5ff8-b13c-4344-a7f1-06cfb43709fd tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:46.640237 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-619e5ff8-b13c-4344-a7f1-06cfb43709fd tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:46.644004 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-beec1687-01db-465c-bd4b-ba1b7eae5be0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:46.644449 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-beec1687-01db-465c-bd4b-ba1b7eae5be0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:46.645252 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-beec1687-01db-465c-bd4b-ba1b7eae5be0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:46.645679 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-beec1687-01db-465c-bd4b-ba1b7eae5be0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:46.648821 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-619e5ff8-b13c-4344-a7f1-06cfb43709fd tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:46.649371 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-619e5ff8-b13c-4344-a7f1-06cfb43709fd tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:46.650254 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-619e5ff8-b13c-4344-a7f1-06cfb43709fd tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:46.650754 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-619e5ff8-b13c-4344-a7f1-06cfb43709fd tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:46.846462 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-beec1687-01db-465c-bd4b-ba1b7eae5be0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:46.854320 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-beec1687-01db-465c-bd4b-ba1b7eae5be0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1322 microversion: 2.1 time: 0.223946 Jul 28 18:13:46.854896 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 97/201] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:46 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1322 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:46.861805 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-619e5ff8-b13c-4344-a7f1-06cfb43709fd tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:46.870690 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-619e5ff8-b13c-4344-a7f1-06cfb43709fd tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:46.872200 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-619e5ff8-b13c-4344-a7f1-06cfb43709fd tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:46.873387 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-619e5ff8-b13c-4344-a7f1-06cfb43709fd tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1405 microversion: 2.20 time: 0.237690 Jul 28 18:13:46.873962 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 105/202] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:13:46 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1405 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:13:47.065492 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b31744f3-3c0d-43e1-a5de-42145507ef99 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:47.066112 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b31744f3-3c0d-43e1-a5de-42145507ef99 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:47.071134 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-58542b5b-fa4d-47e9-829f-5cce5b16b3c0 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:47.071947 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-58542b5b-fa4d-47e9-829f-5cce5b16b3c0 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:47.073011 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b31744f3-3c0d-43e1-a5de-42145507ef99 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:47.073560 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b31744f3-3c0d-43e1-a5de-42145507ef99 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:47.074342 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b31744f3-3c0d-43e1-a5de-42145507ef99 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:47.074780 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b31744f3-3c0d-43e1-a5de-42145507ef99 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:47.080945 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-58542b5b-fa4d-47e9-829f-5cce5b16b3c0 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:47.081721 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-58542b5b-fa4d-47e9-829f-5cce5b16b3c0 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:47.082901 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-58542b5b-fa4d-47e9-829f-5cce5b16b3c0 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:47.083909 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-58542b5b-fa4d-47e9-829f-5cce5b16b3c0 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:47.289165 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-58542b5b-fa4d-47e9-829f-5cce5b16b3c0 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96e9a9e40c54b6a9a7f8560e4846be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef52881d75f407a942bf960230ea22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:47.299198 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-58542b5b-fa4d-47e9-829f-5cce5b16b3c0 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436" status: 200 len: 1314 microversion: 2.1 time: 0.232772 Jul 28 18:13:47.299847 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 106/203] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:47 2022] GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:13:47.313632 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b31744f3-3c0d-43e1-a5de-42145507ef99 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:47.321973 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b31744f3-3c0d-43e1-a5de-42145507ef99 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1363 microversion: 2.1 time: 0.260345 Jul 28 18:13:47.322541 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 98/204] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:47 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1363 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:47.875376 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-e5543e71-b5be-4019-a9b5-339a230f0906 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:47.875978 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-e5543e71-b5be-4019-a9b5-339a230f0906 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:47.882743 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e5543e71-b5be-4019-a9b5-339a230f0906 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:47.883192 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e5543e71-b5be-4019-a9b5-339a230f0906 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:47.883942 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e5543e71-b5be-4019-a9b5-339a230f0906 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:47.884378 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e5543e71-b5be-4019-a9b5-339a230f0906 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:47.897699 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-c6290159-6c9c-4792-bd66-829fc5063067 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:47.898365 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-c6290159-6c9c-4792-bd66-829fc5063067 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:47.912699 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c6290159-6c9c-4792-bd66-829fc5063067 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:47.913230 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c6290159-6c9c-4792-bd66-829fc5063067 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:47.914086 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c6290159-6c9c-4792-bd66-829fc5063067 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:47.914530 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c6290159-6c9c-4792-bd66-829fc5063067 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:48.092551 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-e5543e71-b5be-4019-a9b5-339a230f0906 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:48.108691 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-e5543e71-b5be-4019-a9b5-339a230f0906 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1322 microversion: 2.1 time: 0.236861 Jul 28 18:13:48.109660 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 107/205] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:47 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1322 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:48.124424 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-c6290159-6c9c-4792-bd66-829fc5063067 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:48.133742 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-c6290159-6c9c-4792-bd66-829fc5063067 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:48.135261 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-c6290159-6c9c-4792-bd66-829fc5063067 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:48.136370 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-c6290159-6c9c-4792-bd66-829fc5063067 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1405 microversion: 2.20 time: 0.243601 Jul 28 18:13:48.137015 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 99/206] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:13:47 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1405 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:13:48.319533 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-79e33a34-cb96-4b3c-8394-a1ea6a52ba14 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:48.320107 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-79e33a34-cb96-4b3c-8394-a1ea6a52ba14 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:48.326220 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-79e33a34-cb96-4b3c-8394-a1ea6a52ba14 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:48.326666 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-79e33a34-cb96-4b3c-8394-a1ea6a52ba14 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:48.327422 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-79e33a34-cb96-4b3c-8394-a1ea6a52ba14 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:48.327855 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-79e33a34-cb96-4b3c-8394-a1ea6a52ba14 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:48.343761 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-dc24c1f7-e58e-48d6-bcb9-b011968b8d3c tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:48.344616 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-dc24c1f7-e58e-48d6-bcb9-b011968b8d3c tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:48.352293 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dc24c1f7-e58e-48d6-bcb9-b011968b8d3c tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:48.353006 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dc24c1f7-e58e-48d6-bcb9-b011968b8d3c tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:48.353928 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dc24c1f7-e58e-48d6-bcb9-b011968b8d3c tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:48.354504 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dc24c1f7-e58e-48d6-bcb9-b011968b8d3c tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:48.543378 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-dc24c1f7-e58e-48d6-bcb9-b011968b8d3c tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:48.547274 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-79e33a34-cb96-4b3c-8394-a1ea6a52ba14 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96e9a9e40c54b6a9a7f8560e4846be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef52881d75f407a942bf960230ea22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:48.548736 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-dc24c1f7-e58e-48d6-bcb9-b011968b8d3c tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1363 microversion: 2.1 time: 0.208962 Jul 28 18:13:48.549878 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 100/207] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:48 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1363 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:13:48.558752 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-79e33a34-cb96-4b3c-8394-a1ea6a52ba14 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436" status: 200 len: 1314 microversion: 2.1 time: 0.242988 Jul 28 18:13:48.559423 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 108/208] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:48 2022] GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:49.133615 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-4c515e53-3d74-4af2-bda3-5b77b7b33aac tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:49.134250 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-4c515e53-3d74-4af2-bda3-5b77b7b33aac tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:49.140210 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4c515e53-3d74-4af2-bda3-5b77b7b33aac tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:49.140654 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4c515e53-3d74-4af2-bda3-5b77b7b33aac tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:49.141436 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4c515e53-3d74-4af2-bda3-5b77b7b33aac tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:49.141867 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4c515e53-3d74-4af2-bda3-5b77b7b33aac tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:49.159689 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-9bfb21fe-6f26-4234-8f0d-555c416fc0c2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:49.160330 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-9bfb21fe-6f26-4234-8f0d-555c416fc0c2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:49.166670 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-9bfb21fe-6f26-4234-8f0d-555c416fc0c2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:49.167146 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-9bfb21fe-6f26-4234-8f0d-555c416fc0c2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:49.167940 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-9bfb21fe-6f26-4234-8f0d-555c416fc0c2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:49.168377 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-9bfb21fe-6f26-4234-8f0d-555c416fc0c2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:49.368072 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-4c515e53-3d74-4af2-bda3-5b77b7b33aac tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:49.377440 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-4c515e53-3d74-4af2-bda3-5b77b7b33aac tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1322 microversion: 2.1 time: 0.247505 Jul 28 18:13:49.378234 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 101/209] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:49 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1322 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:13:49.385300 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-9bfb21fe-6f26-4234-8f0d-555c416fc0c2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:49.393313 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-9bfb21fe-6f26-4234-8f0d-555c416fc0c2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:49.394859 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-9bfb21fe-6f26-4234-8f0d-555c416fc0c2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:49.395948 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-9bfb21fe-6f26-4234-8f0d-555c416fc0c2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1405 microversion: 2.20 time: 0.240182 Jul 28 18:13:49.396520 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 109/210] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:13:49 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1405 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:13:49.570924 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-25ca18c3-2540-4b69-830a-2dbb2e2861f4 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:49.571711 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-25ca18c3-2540-4b69-830a-2dbb2e2861f4 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:49.578418 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-25ca18c3-2540-4b69-830a-2dbb2e2861f4 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:49.579303 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-25ca18c3-2540-4b69-830a-2dbb2e2861f4 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:49.579389 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-2ab28b11-27c7-4e35-8213-83d050801c3a tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:49.579950 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-25ca18c3-2540-4b69-830a-2dbb2e2861f4 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:49.580058 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-2ab28b11-27c7-4e35-8213-83d050801c3a tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:49.580394 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-25ca18c3-2540-4b69-830a-2dbb2e2861f4 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:49.586544 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2ab28b11-27c7-4e35-8213-83d050801c3a tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:49.586992 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2ab28b11-27c7-4e35-8213-83d050801c3a tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:49.587784 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2ab28b11-27c7-4e35-8213-83d050801c3a tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:49.588220 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2ab28b11-27c7-4e35-8213-83d050801c3a tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:49.846273 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-2ab28b11-27c7-4e35-8213-83d050801c3a tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96e9a9e40c54b6a9a7f8560e4846be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef52881d75f407a942bf960230ea22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:49.853292 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-25ca18c3-2540-4b69-830a-2dbb2e2861f4 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:49.862636 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-25ca18c3-2540-4b69-830a-2dbb2e2861f4 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1363 microversion: 2.1 time: 0.295908 Jul 28 18:13:49.866079 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-2ab28b11-27c7-4e35-8213-83d050801c3a tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436" status: 200 len: 1499 microversion: 2.1 time: 0.290750 Jul 28 18:13:49.866577 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 102/211] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:49 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1363 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:49.867750 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 110/212] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:49 2022] GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 => generated 1499 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:13:50.398612 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-aea1a6f0-abc5-44bd-9678-33c4c4bba3df tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:50.399224 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-aea1a6f0-abc5-44bd-9678-33c4c4bba3df tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:50.407224 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-aea1a6f0-abc5-44bd-9678-33c4c4bba3df tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:50.407687 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-aea1a6f0-abc5-44bd-9678-33c4c4bba3df tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:50.408470 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-aea1a6f0-abc5-44bd-9678-33c4c4bba3df tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:50.408911 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-aea1a6f0-abc5-44bd-9678-33c4c4bba3df tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:50.418711 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-9160fa52-01d9-4395-ba23-0f0887b74861 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:50.421195 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-9160fa52-01d9-4395-ba23-0f0887b74861 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:50.431677 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-9160fa52-01d9-4395-ba23-0f0887b74861 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:50.432452 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-9160fa52-01d9-4395-ba23-0f0887b74861 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:50.434053 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-9160fa52-01d9-4395-ba23-0f0887b74861 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:50.436696 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-9160fa52-01d9-4395-ba23-0f0887b74861 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:50.649065 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-9160fa52-01d9-4395-ba23-0f0887b74861 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:50.653061 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-aea1a6f0-abc5-44bd-9678-33c4c4bba3df tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:50.660709 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-aea1a6f0-abc5-44bd-9678-33c4c4bba3df tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1322 microversion: 2.1 time: 0.266457 Jul 28 18:13:50.673137 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 103/213] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:50 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1322 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:50.674695 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-9160fa52-01d9-4395-ba23-0f0887b74861 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:50.676225 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-9160fa52-01d9-4395-ba23-0f0887b74861 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:50.677380 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-9160fa52-01d9-4395-ba23-0f0887b74861 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1405 microversion: 2.20 time: 0.262816 Jul 28 18:13:50.679475 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 111/214] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:13:50 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1405 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:13:50.885892 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5e8988b5-ee7d-4d02-9326-cd6e0620a0d6 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:50.886898 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-5e8988b5-ee7d-4d02-9326-cd6e0620a0d6 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:50.892760 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5e8988b5-ee7d-4d02-9326-cd6e0620a0d6 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:50.893395 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5e8988b5-ee7d-4d02-9326-cd6e0620a0d6 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:50.894380 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5e8988b5-ee7d-4d02-9326-cd6e0620a0d6 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:50.894920 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5e8988b5-ee7d-4d02-9326-cd6e0620a0d6 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:51.044092 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-5e8988b5-ee7d-4d02-9326-cd6e0620a0d6 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:51.057785 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-5e8988b5-ee7d-4d02-9326-cd6e0620a0d6 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1549 microversion: 2.1 time: 0.177919 Jul 28 18:13:51.081315 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 104/215] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:50 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1549 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:51.093139 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-d8f2ae8f-fd27-427d-8366-c19c83e98ae7 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:51.094141 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-d8f2ae8f-fd27-427d-8366-c19c83e98ae7 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:51.101455 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d8f2ae8f-fd27-427d-8366-c19c83e98ae7 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:51.102143 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d8f2ae8f-fd27-427d-8366-c19c83e98ae7 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:51.103354 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d8f2ae8f-fd27-427d-8366-c19c83e98ae7 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:51.103945 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d8f2ae8f-fd27-427d-8366-c19c83e98ae7 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:51.250864 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-d8f2ae8f-fd27-427d-8366-c19c83e98ae7 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.167549 Jul 28 18:13:51.251909 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 112/216] 10.222.0.86 () {58 vars in 1275 bytes} [Thu Jul 28 18:13:51 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd/os-interface => generated 284 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:13:51.682805 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-95aa9df7-3566-4ed2-b554-5db505faad59 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:51.683559 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-95aa9df7-3566-4ed2-b554-5db505faad59 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:51.690067 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-95aa9df7-3566-4ed2-b554-5db505faad59 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:51.690913 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-95aa9df7-3566-4ed2-b554-5db505faad59 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:51.694966 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-95aa9df7-3566-4ed2-b554-5db505faad59 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:51.694966 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-95aa9df7-3566-4ed2-b554-5db505faad59 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:51.702806 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-c59bc9d7-df15-460d-b655-b55193f13dc8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:51.704164 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-c59bc9d7-df15-460d-b655-b55193f13dc8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:51.711382 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c59bc9d7-df15-460d-b655-b55193f13dc8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:51.712041 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c59bc9d7-df15-460d-b655-b55193f13dc8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:51.713071 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c59bc9d7-df15-460d-b655-b55193f13dc8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:51.713665 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c59bc9d7-df15-460d-b655-b55193f13dc8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:51.918533 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-c59bc9d7-df15-460d-b655-b55193f13dc8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:51.926429 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-95aa9df7-3566-4ed2-b554-5db505faad59 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:51.927966 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-c59bc9d7-df15-460d-b655-b55193f13dc8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:51.931151 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-c59bc9d7-df15-460d-b655-b55193f13dc8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:51.933358 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-c59bc9d7-df15-460d-b655-b55193f13dc8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1405 microversion: 2.20 time: 0.234528 Jul 28 18:13:51.934014 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 113/217] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:13:51 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1405 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:13:51.947702 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-95aa9df7-3566-4ed2-b554-5db505faad59 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1322 microversion: 2.1 time: 0.256215 Jul 28 18:13:51.947702 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 105/218] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:51 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1322 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:52.921083 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-4056c96d-4f28-4c22-9b86-c334ad7700e3 req-b33f42ac-f80e-41c1-a843-11d9f9086300 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f8c8622-dfde-4eb5-95c4-7716aebf0fcd", "tag": "7d6f0f21-22dc-4e8d-82cd-162059368b29"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:13:52.934979 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-4056c96d-4f28-4c22-9b86-c334ad7700e3 req-b33f42ac-f80e-41c1-a843-11d9f9086300 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:52.935519 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-4056c96d-4f28-4c22-9b86-c334ad7700e3 req-b33f42ac-f80e-41c1-a843-11d9f9086300 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:52.955556 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-5970a7c9-4d74-4acc-90d6-9f5aeb1f4db2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:52.956857 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-5970a7c9-4d74-4acc-90d6-9f5aeb1f4db2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:52.963973 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-4056c96d-4f28-4c22-9b86-c334ad7700e3 req-b33f42ac-f80e-41c1-a843-11d9f9086300 service nova] Creating event network-changed:7d6f0f21-22dc-4e8d-82cd-162059368b29 for instance 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd on hv-cinder-84617 Jul 28 18:13:52.979140 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-4056c96d-4f28-4c22-9b86-c334ad7700e3 req-b33f42ac-f80e-41c1-a843-11d9f9086300 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066934 Jul 28 18:13:52.979633 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-5970a7c9-4d74-4acc-90d6-9f5aeb1f4db2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:52.980726 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-5970a7c9-4d74-4acc-90d6-9f5aeb1f4db2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:52.982334 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-5970a7c9-4d74-4acc-90d6-9f5aeb1f4db2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:52.984037 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-5970a7c9-4d74-4acc-90d6-9f5aeb1f4db2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:52.998690 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 106/219] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:13:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 18:13:53.000696 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-433fdbd3-73af-4f23-a588-edb992e48210 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:53.004756 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-433fdbd3-73af-4f23-a588-edb992e48210 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:53.017643 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-433fdbd3-73af-4f23-a588-edb992e48210 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:53.018391 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-433fdbd3-73af-4f23-a588-edb992e48210 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:53.019382 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-433fdbd3-73af-4f23-a588-edb992e48210 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:53.020027 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-433fdbd3-73af-4f23-a588-edb992e48210 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:53.271855 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-5970a7c9-4d74-4acc-90d6-9f5aeb1f4db2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:53.282605 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-5970a7c9-4d74-4acc-90d6-9f5aeb1f4db2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:53.285552 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-5970a7c9-4d74-4acc-90d6-9f5aeb1f4db2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:53.287640 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-5970a7c9-4d74-4acc-90d6-9f5aeb1f4db2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1405 microversion: 2.20 time: 0.335379 Jul 28 18:13:53.289738 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 114/220] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:13:52 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1405 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:13:53.301065 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-433fdbd3-73af-4f23-a588-edb992e48210 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:53.310724 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-8b4d6f70-cf8c-45b8-a03e-67d64c54f652 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6b3b32a4-b162-42ba-bfdf-78c468139445"}} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:13:53.316591 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-433fdbd3-73af-4f23-a588-edb992e48210 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1322 microversion: 2.1 time: 0.321877 Jul 28 18:13:53.317401 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-8b4d6f70-cf8c-45b8-a03e-67d64c54f652 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:53.325768 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 107/221] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:52 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1322 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:53.330207 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-8b4d6f70-cf8c-45b8-a03e-67d64c54f652 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:53.330849 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-8b4d6f70-cf8c-45b8-a03e-67d64c54f652 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:53.331822 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-8b4d6f70-cf8c-45b8-a03e-67d64c54f652 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:53.332264 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-8b4d6f70-cf8c-45b8-a03e-67d64c54f652 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:53.720100 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-9140677b-2fb8-455f-b451-f3b70b63479e req-4e3a8a10-b576-43bd-8b48-cc8053c325e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75328faf-ff9c-4e13-9643-bb73b0079a5a", "name": "network-vif-plugged", "status": "completed", "tag": "ae8cbb70-b373-4a44-b403-9f6ac40dbbca"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:13:53.735905 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-9140677b-2fb8-455f-b451-f3b70b63479e req-4e3a8a10-b576-43bd-8b48-cc8053c325e9 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:53.736347 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-9140677b-2fb8-455f-b451-f3b70b63479e req-4e3a8a10-b576-43bd-8b48-cc8053c325e9 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:53.750725 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-9140677b-2fb8-455f-b451-f3b70b63479e req-4e3a8a10-b576-43bd-8b48-cc8053c325e9 service nova] Creating event network-vif-plugged:ae8cbb70-b373-4a44-b403-9f6ac40dbbca for instance 75328faf-ff9c-4e13-9643-bb73b0079a5a on hv-cinder-84617 Jul 28 18:13:53.756553 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-9140677b-2fb8-455f-b451-f3b70b63479e req-4e3a8a10-b576-43bd-8b48-cc8053c325e9 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040075 Jul 28 18:13:53.757471 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 108/222] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 18:13:54.314465 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-4b451626-b984-471d-92ff-2435f7f08b9d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:54.315555 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-4b451626-b984-471d-92ff-2435f7f08b9d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:54.355247 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4b451626-b984-471d-92ff-2435f7f08b9d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:54.358018 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4b451626-b984-471d-92ff-2435f7f08b9d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:54.359384 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4b451626-b984-471d-92ff-2435f7f08b9d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:54.361428 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4b451626-b984-471d-92ff-2435f7f08b9d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:54.894958 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-4b451626-b984-471d-92ff-2435f7f08b9d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:54.914132 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-4b451626-b984-471d-92ff-2435f7f08b9d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:54.915853 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-4b451626-b984-471d-92ff-2435f7f08b9d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:54.918403 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-4b451626-b984-471d-92ff-2435f7f08b9d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1405 microversion: 2.20 time: 0.608636 Jul 28 18:13:54.921671 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 109/223] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:13:54 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1405 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:13:54.961687 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b06db9bc-63b1-47d9-bb1a-20f73b90f7d5 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:54.962356 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b06db9bc-63b1-47d9-bb1a-20f73b90f7d5 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:54.969816 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b06db9bc-63b1-47d9-bb1a-20f73b90f7d5 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:54.970468 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b06db9bc-63b1-47d9-bb1a-20f73b90f7d5 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:54.971610 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b06db9bc-63b1-47d9-bb1a-20f73b90f7d5 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:54.972190 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b06db9bc-63b1-47d9-bb1a-20f73b90f7d5 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:54.999760 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:13:55.140502 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b06db9bc-63b1-47d9-bb1a-20f73b90f7d5 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:55.140701 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-8b4d6f70-cf8c-45b8-a03e-67d64c54f652 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "POST /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.843379 Jul 28 18:13:55.140701 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 115/224] 10.222.0.86 () {60 vars in 1323 bytes} [Thu Jul 28 18:13:53 2022] POST /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436/os-volume_attachments => generated 194 bytes in 1846 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:13:55.141239 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b06db9bc-63b1-47d9-bb1a-20f73b90f7d5 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1322 microversion: 2.1 time: 0.214693 Jul 28 18:13:55.141239 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 110/225] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:54 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:55.944829 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-42c8fb31-1213-42cc-8649-0f8f531cf2f2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:55.945599 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-42c8fb31-1213-42cc-8649-0f8f531cf2f2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:55.952885 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-42c8fb31-1213-42cc-8649-0f8f531cf2f2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:55.953337 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-42c8fb31-1213-42cc-8649-0f8f531cf2f2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:55.954101 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-42c8fb31-1213-42cc-8649-0f8f531cf2f2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:55.956613 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-42c8fb31-1213-42cc-8649-0f8f531cf2f2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:55.959691 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:13:56.093850 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-42c8fb31-1213-42cc-8649-0f8f531cf2f2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:56.106565 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-42c8fb31-1213-42cc-8649-0f8f531cf2f2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:56.108117 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-42c8fb31-1213-42cc-8649-0f8f531cf2f2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:56.109780 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-42c8fb31-1213-42cc-8649-0f8f531cf2f2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1596 microversion: 2.20 time: 0.169675 Jul 28 18:13:56.110753 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 116/226] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:13:55 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1596 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:13:56.134726 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f8b236f3-76a2-4d01-955d-759932862b1f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:56.135428 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f8b236f3-76a2-4d01-955d-759932862b1f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:56.141785 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f8b236f3-76a2-4d01-955d-759932862b1f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:56.142230 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f8b236f3-76a2-4d01-955d-759932862b1f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:56.142994 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f8b236f3-76a2-4d01-955d-759932862b1f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:56.143432 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f8b236f3-76a2-4d01-955d-759932862b1f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:56.161334 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-f8be957c-20a0-4506-87fc-45082e06dc8d tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:56.163229 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-f8be957c-20a0-4506-87fc-45082e06dc8d tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:56.169419 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f8be957c-20a0-4506-87fc-45082e06dc8d tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:56.169921 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f8be957c-20a0-4506-87fc-45082e06dc8d tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:56.171073 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f8be957c-20a0-4506-87fc-45082e06dc8d tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:56.172248 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f8be957c-20a0-4506-87fc-45082e06dc8d tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:56.342156 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f8b236f3-76a2-4d01-955d-759932862b1f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.211929 Jul 28 18:13:56.343062 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 111/227] 10.222.0.86 () {60 vars in 1316 bytes} [Thu Jul 28 18:13:56 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286/os-interface => generated 284 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 18:13:56.441753 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-f8be957c-20a0-4506-87fc-45082e06dc8d tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:56.450921 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-f8be957c-20a0-4506-87fc-45082e06dc8d tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1322 microversion: 2.1 time: 0.294380 Jul 28 18:13:56.451603 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 117/228] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:56 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1322 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:13:57.474550 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ebf276a1-1086-40d0-b7fb-5021d035b299 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:57.475061 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ebf276a1-1086-40d0-b7fb-5021d035b299 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:57.485222 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ebf276a1-1086-40d0-b7fb-5021d035b299 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:57.485658 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ebf276a1-1086-40d0-b7fb-5021d035b299 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:57.487432 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ebf276a1-1086-40d0-b7fb-5021d035b299 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:57.487892 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ebf276a1-1086-40d0-b7fb-5021d035b299 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:57.573532 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [req-02ceee3d-a08d-460b-bb72-4ca1d631e31d req-2626fb0f-8086-48fc-9663-e37b6f804307 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b1c63c9-4f4b-4c9e-91da-42f88fd63286", "tag": "1d258458-0cee-481c-93c4-bf0b858d9e28"}]} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:13:57.596773 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-02ceee3d-a08d-460b-bb72-4ca1d631e31d req-2626fb0f-8086-48fc-9663-e37b6f804307 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:57.597465 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-02ceee3d-a08d-460b-bb72-4ca1d631e31d req-2626fb0f-8086-48fc-9663-e37b6f804307 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:57.615102 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.compute.server_external_events [req-02ceee3d-a08d-460b-bb72-4ca1d631e31d req-2626fb0f-8086-48fc-9663-e37b6f804307 service nova] Creating event network-changed:1d258458-0cee-481c-93c4-bf0b858d9e28 for instance 2b1c63c9-4f4b-4c9e-91da-42f88fd63286 on hv-cinder-84617 Jul 28 18:13:57.621485 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [req-02ceee3d-a08d-460b-bb72-4ca1d631e31d req-2626fb0f-8086-48fc-9663-e37b6f804307 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052141 Jul 28 18:13:57.622401 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 118/229] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:13:57.670843 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ebf276a1-1086-40d0-b7fb-5021d035b299 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:57.680589 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ebf276a1-1086-40d0-b7fb-5021d035b299 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1322 microversion: 2.1 time: 0.212075 Jul 28 18:13:57.681839 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 112/230] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:57 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1322 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:58.702433 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-ff3510fd-ef38-4b3d-ae60-d395d35d7033 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:58.703868 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-ff3510fd-ef38-4b3d-ae60-d395d35d7033 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:58.711164 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ff3510fd-ef38-4b3d-ae60-d395d35d7033 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:58.711620 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ff3510fd-ef38-4b3d-ae60-d395d35d7033 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:58.712393 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ff3510fd-ef38-4b3d-ae60-d395d35d7033 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:58.712834 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ff3510fd-ef38-4b3d-ae60-d395d35d7033 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:58.904007 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-ff3510fd-ef38-4b3d-ae60-d395d35d7033 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:58.914216 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-ff3510fd-ef38-4b3d-ae60-d395d35d7033 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1517 microversion: 2.1 time: 0.215965 Jul 28 18:13:58.917119 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 119/231] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:58 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1517 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:58.947120 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ca7a501b-eda9-4485-88db-ae0e9204d0e2 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:13:58.949512 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ca7a501b-eda9-4485-88db-ae0e9204d0e2 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:58.957235 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ca7a501b-eda9-4485-88db-ae0e9204d0e2 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:58.959659 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ca7a501b-eda9-4485-88db-ae0e9204d0e2 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:58.960429 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ca7a501b-eda9-4485-88db-ae0e9204d0e2 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:58.960883 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ca7a501b-eda9-4485-88db-ae0e9204d0e2 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:58.971598 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-c1023ce9-a458-487d-8dc2-772b77bff6dd tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1616959911", "imageRef": "61912422-61cd-4ced-a573-85ee305e010f", "flavorRef": "452", "networks": [{"uuid": "23614efc-eed1-4326-a701-6c2e93f9f59c"}]}} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:13:58.999781 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.objects.instance [None req-ca7a501b-eda9-4485-88db-ae0e9204d0e2 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lazy-loading 'flavor' on Instance uuid 75328faf-ff9c-4e13-9643-bb73b0079a5a {{(pid=118453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:13:59.032076 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.network.neutron [None req-c1023ce9-a458-487d-8dc2-772b77bff6dd tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] validate_networks() for [('23614efc-eed1-4326-a701-6c2e93f9f59c', None, None, None, None, None)] {{(pid=118454) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 18:13:59.382645 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.virt.hardware [None req-c1023ce9-a458-487d-8dc2-772b77bff6dd tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Flavor limits 0:0:0 {{(pid=118454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 18:13:59.383571 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.virt.hardware [None req-c1023ce9-a458-487d-8dc2-772b77bff6dd tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Image limits 0:0:0 {{(pid=118454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 18:13:59.384161 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.virt.hardware [None req-c1023ce9-a458-487d-8dc2-772b77bff6dd tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Flavor pref 0:0:0 {{(pid=118454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 18:13:59.384646 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.virt.hardware [None req-c1023ce9-a458-487d-8dc2-772b77bff6dd tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Image pref 0:0:0 {{(pid=118454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 18:13:59.385193 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.virt.hardware [None req-c1023ce9-a458-487d-8dc2-772b77bff6dd tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 18:13:59.394321 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c1023ce9-a458-487d-8dc2-772b77bff6dd tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:59.394777 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c1023ce9-a458-487d-8dc2-772b77bff6dd tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:59.395579 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c1023ce9-a458-487d-8dc2-772b77bff6dd tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:59.396052 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c1023ce9-a458-487d-8dc2-772b77bff6dd tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:59.416421 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ca7a501b-eda9-4485-88db-ae0e9204d0e2 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "POST /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a/action" status: 200 len: 32 microversion: 2.1 time: 0.474426 Jul 28 18:13:59.418141 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 113/232] 10.222.0.86 () {60 vars in 1278 bytes} [Thu Jul 28 18:13:58 2022] POST /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a/action => generated 32 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 18:13:59.422090 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.quota [None req-c1023ce9-a458-487d-8dc2-772b77bff6dd tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Getting quotas for project 85d8da2c21474c958de9039caa0b547d. Resources: {'cores', 'ram', 'instances'} {{(pid=118454) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 18:13:59.426958 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.quota [None req-c1023ce9-a458-487d-8dc2-772b77bff6dd tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Getting quotas for user a794c5d63c0f499db264113d64ae63b5 and project 85d8da2c21474c958de9039caa0b547d. Resources: {'cores', 'ram', 'instances'} {{(pid=118454) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 18:13:59.429868 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-40b1fa07-dfa4-4da2-a6ab-aa0d137431b9 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:59.430774 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-40b1fa07-dfa4-4da2-a6ab-aa0d137431b9 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:59.439155 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-40b1fa07-dfa4-4da2-a6ab-aa0d137431b9 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:59.439752 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-40b1fa07-dfa4-4da2-a6ab-aa0d137431b9 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:59.444536 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-c1023ce9-a458-487d-8dc2-772b77bff6dd tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Going to run 1 instances... {{(pid=118454) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 18:13:59.444846 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-40b1fa07-dfa4-4da2-a6ab-aa0d137431b9 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:59.444846 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-40b1fa07-dfa4-4da2-a6ab-aa0d137431b9 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:59.445056 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-c1023ce9-a458-487d-8dc2-772b77bff6dd tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] [instance: 88ed5c44-308f-42a6-86ca-9b4e58b3af9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='61912422-61cd-4ced-a573-85ee305e010f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118454) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 18:13:59.470022 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:13:59.551967 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-c1023ce9-a458-487d-8dc2-772b77bff6dd tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.584078 Jul 28 18:13:59.553252 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 120/233] 10.222.0.86 () {60 vars in 1147 bytes} [Thu Jul 28 18:13:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 586 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 18:13:59.590648 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-90ea1fb0-cc14-4932-ab21-e1608b203b8b tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:59.591269 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-90ea1fb0-cc14-4932-ab21-e1608b203b8b tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] [instance: 88ed5c44-308f-42a6-86ca-9b4e58b3af9b] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:59.596049 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-40b1fa07-dfa4-4da2-a6ab-aa0d137431b9 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:59.614739 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-40b1fa07-dfa4-4da2-a6ab-aa0d137431b9 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1523 microversion: 2.1 time: 0.190627 Jul 28 18:13:59.618306 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 114/234] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:59 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1523 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:59.671131 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-90ea1fb0-cc14-4932-ab21-e1608b203b8b tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a794c5d63c0f499db264113d64ae63b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d8da2c21474c958de9039caa0b547d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:59.679320 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-90ea1fb0-cc14-4932-ab21-e1608b203b8b tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] 10.222.0.86 "GET /compute/v2.1/servers/88ed5c44-308f-42a6-86ca-9b4e58b3af9b" status: 200 len: 1214 microversion: 2.1 time: 0.119126 Jul 28 18:13:59.681375 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 121/235] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:59 2022] GET /compute/v2.1/servers/88ed5c44-308f-42a6-86ca-9b4e58b3af9b => generated 1214 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:14:00.636930 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b626ff1a-b354-4d72-8271-076d34ffc8ba tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:00.637857 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b626ff1a-b354-4d72-8271-076d34ffc8ba tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:00.645238 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b626ff1a-b354-4d72-8271-076d34ffc8ba tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:00.652051 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b626ff1a-b354-4d72-8271-076d34ffc8ba tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:00.652051 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b626ff1a-b354-4d72-8271-076d34ffc8ba tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:00.652051 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b626ff1a-b354-4d72-8271-076d34ffc8ba tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:00.700523 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-ea56ddd2-73a4-4de7-b460-d76819292d7a tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:00.701184 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-ea56ddd2-73a4-4de7-b460-d76819292d7a tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] [instance: 88ed5c44-308f-42a6-86ca-9b4e58b3af9b] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:00.708615 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ea56ddd2-73a4-4de7-b460-d76819292d7a tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:00.709967 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ea56ddd2-73a4-4de7-b460-d76819292d7a tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:00.710758 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ea56ddd2-73a4-4de7-b460-d76819292d7a tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:00.711199 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ea56ddd2-73a4-4de7-b460-d76819292d7a tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:00.783931 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-ea56ddd2-73a4-4de7-b460-d76819292d7a tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a794c5d63c0f499db264113d64ae63b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d8da2c21474c958de9039caa0b547d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:00.793502 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-ea56ddd2-73a4-4de7-b460-d76819292d7a tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] 10.222.0.86 "GET /compute/v2.1/servers/88ed5c44-308f-42a6-86ca-9b4e58b3af9b" status: 200 len: 1218 microversion: 2.1 time: 0.096955 Jul 28 18:14:00.808564 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 122/236] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:00 2022] GET /compute/v2.1/servers/88ed5c44-308f-42a6-86ca-9b4e58b3af9b => generated 1218 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:00.816481 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b626ff1a-b354-4d72-8271-076d34ffc8ba tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:00.824721 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b626ff1a-b354-4d72-8271-076d34ffc8ba tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1523 microversion: 2.1 time: 0.192513 Jul 28 18:14:00.825589 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 115/237] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:00 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1523 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:01.815650 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-6cf147fe-4add-4ff9-b8f7-6b98169fa8ab tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:01.816260 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-6cf147fe-4add-4ff9-b8f7-6b98169fa8ab tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] [instance: 88ed5c44-308f-42a6-86ca-9b4e58b3af9b] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:01.823255 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-6cf147fe-4add-4ff9-b8f7-6b98169fa8ab tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:01.823711 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-6cf147fe-4add-4ff9-b8f7-6b98169fa8ab tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:01.824477 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-6cf147fe-4add-4ff9-b8f7-6b98169fa8ab tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:01.824917 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-6cf147fe-4add-4ff9-b8f7-6b98169fa8ab tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:01.845618 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-76423c0c-bb97-4e2a-8daa-36ddac80b274 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:01.846209 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-76423c0c-bb97-4e2a-8daa-36ddac80b274 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:01.852814 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-76423c0c-bb97-4e2a-8daa-36ddac80b274 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:01.853255 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-76423c0c-bb97-4e2a-8daa-36ddac80b274 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:01.854026 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-76423c0c-bb97-4e2a-8daa-36ddac80b274 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:01.854471 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-76423c0c-bb97-4e2a-8daa-36ddac80b274 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:01.888624 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-6cf147fe-4add-4ff9-b8f7-6b98169fa8ab tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a794c5d63c0f499db264113d64ae63b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d8da2c21474c958de9039caa0b547d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:01.896687 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-6cf147fe-4add-4ff9-b8f7-6b98169fa8ab tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] 10.222.0.86 "GET /compute/v2.1/servers/88ed5c44-308f-42a6-86ca-9b4e58b3af9b" status: 200 len: 1218 microversion: 2.1 time: 0.084733 Jul 28 18:14:01.897613 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 123/238] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:01 2022] GET /compute/v2.1/servers/88ed5c44-308f-42a6-86ca-9b4e58b3af9b => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:01.991527 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-76423c0c-bb97-4e2a-8daa-36ddac80b274 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:01.999074 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-76423c0c-bb97-4e2a-8daa-36ddac80b274 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1523 microversion: 2.1 time: 0.157580 Jul 28 18:14:02.012075 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 116/239] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:01 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:14:02.917389 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-e946a2bd-b69b-4da1-9168-b24ae66e01b7 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:02.917995 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-e946a2bd-b69b-4da1-9168-b24ae66e01b7 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] [instance: 88ed5c44-308f-42a6-86ca-9b4e58b3af9b] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:02.924486 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e946a2bd-b69b-4da1-9168-b24ae66e01b7 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:02.924936 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e946a2bd-b69b-4da1-9168-b24ae66e01b7 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:02.925731 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e946a2bd-b69b-4da1-9168-b24ae66e01b7 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:02.926202 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e946a2bd-b69b-4da1-9168-b24ae66e01b7 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:02.987891 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-e946a2bd-b69b-4da1-9168-b24ae66e01b7 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a794c5d63c0f499db264113d64ae63b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d8da2c21474c958de9039caa0b547d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:02.995832 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-e946a2bd-b69b-4da1-9168-b24ae66e01b7 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] 10.222.0.86 "GET /compute/v2.1/servers/88ed5c44-308f-42a6-86ca-9b4e58b3af9b" status: 200 len: 1218 microversion: 2.1 time: 0.082518 Jul 28 18:14:02.996394 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 124/240] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:02 2022] GET /compute/v2.1/servers/88ed5c44-308f-42a6-86ca-9b4e58b3af9b => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:03.019538 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-73b72c92-7bbd-4e2e-adf0-c09047478c1f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:03.020152 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-73b72c92-7bbd-4e2e-adf0-c09047478c1f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:03.025159 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=86 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:14:03.026985 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-73b72c92-7bbd-4e2e-adf0-c09047478c1f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:03.027441 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-73b72c92-7bbd-4e2e-adf0-c09047478c1f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:03.028210 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-73b72c92-7bbd-4e2e-adf0-c09047478c1f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:03.028653 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-73b72c92-7bbd-4e2e-adf0-c09047478c1f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:03.162352 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-73b72c92-7bbd-4e2e-adf0-c09047478c1f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:03.171247 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-73b72c92-7bbd-4e2e-adf0-c09047478c1f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1523 microversion: 2.1 time: 0.154501 Jul 28 18:14:03.171247 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 117/241] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:03 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:04.019095 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-cd3007df-8830-49ac-92f0-26d8584135cc tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:04.019702 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-cd3007df-8830-49ac-92f0-26d8584135cc tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] [instance: 88ed5c44-308f-42a6-86ca-9b4e58b3af9b] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:04.026951 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-cd3007df-8830-49ac-92f0-26d8584135cc tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:04.027490 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-cd3007df-8830-49ac-92f0-26d8584135cc tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:04.028307 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-cd3007df-8830-49ac-92f0-26d8584135cc tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:04.028751 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-cd3007df-8830-49ac-92f0-26d8584135cc tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:04.093855 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-cd3007df-8830-49ac-92f0-26d8584135cc tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a794c5d63c0f499db264113d64ae63b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d8da2c21474c958de9039caa0b547d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:04.097592 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-cd3007df-8830-49ac-92f0-26d8584135cc tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] 10.222.0.86 "GET /compute/v2.1/servers/88ed5c44-308f-42a6-86ca-9b4e58b3af9b" status: 200 len: 1218 microversion: 2.1 time: 0.083671 Jul 28 18:14:04.098167 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 125/242] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:04 2022] GET /compute/v2.1/servers/88ed5c44-308f-42a6-86ca-9b4e58b3af9b => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:04.192190 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-378a9f50-c23b-419c-b7da-d3c4f3959888 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:04.192657 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-378a9f50-c23b-419c-b7da-d3c4f3959888 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:04.201094 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-378a9f50-c23b-419c-b7da-d3c4f3959888 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:04.201094 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-378a9f50-c23b-419c-b7da-d3c4f3959888 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:04.201765 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-378a9f50-c23b-419c-b7da-d3c4f3959888 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:04.202286 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-378a9f50-c23b-419c-b7da-d3c4f3959888 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:04.341047 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-378a9f50-c23b-419c-b7da-d3c4f3959888 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:04.348876 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-378a9f50-c23b-419c-b7da-d3c4f3959888 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1523 microversion: 2.1 time: 0.161022 Jul 28 18:14:04.349452 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 118/243] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:04 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:05.119304 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-81b5b217-a7f3-441e-89a6-d3b4a1f3ec95 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:05.119961 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-81b5b217-a7f3-441e-89a6-d3b4a1f3ec95 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] [instance: 88ed5c44-308f-42a6-86ca-9b4e58b3af9b] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:05.126559 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-81b5b217-a7f3-441e-89a6-d3b4a1f3ec95 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:05.126993 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-81b5b217-a7f3-441e-89a6-d3b4a1f3ec95 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:05.128439 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-81b5b217-a7f3-441e-89a6-d3b4a1f3ec95 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:05.128884 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-81b5b217-a7f3-441e-89a6-d3b4a1f3ec95 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:05.202464 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-81b5b217-a7f3-441e-89a6-d3b4a1f3ec95 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a794c5d63c0f499db264113d64ae63b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d8da2c21474c958de9039caa0b547d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:05.211802 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-81b5b217-a7f3-441e-89a6-d3b4a1f3ec95 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] 10.222.0.86 "GET /compute/v2.1/servers/88ed5c44-308f-42a6-86ca-9b4e58b3af9b" status: 200 len: 1218 microversion: 2.1 time: 0.097100 Jul 28 18:14:05.212639 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 126/244] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:05 2022] GET /compute/v2.1/servers/88ed5c44-308f-42a6-86ca-9b4e58b3af9b => generated 1218 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:05.371731 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-43eed63d-d34a-4093-a493-fdf9a3612399 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:05.372906 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-43eed63d-d34a-4093-a493-fdf9a3612399 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:05.379099 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-43eed63d-d34a-4093-a493-fdf9a3612399 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:05.379555 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-43eed63d-d34a-4093-a493-fdf9a3612399 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:05.380327 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-43eed63d-d34a-4093-a493-fdf9a3612399 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:05.385032 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-43eed63d-d34a-4093-a493-fdf9a3612399 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:05.632430 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-43eed63d-d34a-4093-a493-fdf9a3612399 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:05.632430 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-43eed63d-d34a-4093-a493-fdf9a3612399 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1523 microversion: 2.1 time: 0.252036 Jul 28 18:14:05.632430 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 119/245] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:05 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1523 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:06.233346 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-9886402e-ffbd-47cc-ae3c-9fe478d0505b tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:06.233962 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-9886402e-ffbd-47cc-ae3c-9fe478d0505b tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] [instance: 88ed5c44-308f-42a6-86ca-9b4e58b3af9b] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:06.240471 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-9886402e-ffbd-47cc-ae3c-9fe478d0505b tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:06.240918 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-9886402e-ffbd-47cc-ae3c-9fe478d0505b tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:06.241728 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-9886402e-ffbd-47cc-ae3c-9fe478d0505b tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:06.242206 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-9886402e-ffbd-47cc-ae3c-9fe478d0505b tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:06.303913 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-9886402e-ffbd-47cc-ae3c-9fe478d0505b tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a794c5d63c0f499db264113d64ae63b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d8da2c21474c958de9039caa0b547d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:06.316392 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-9886402e-ffbd-47cc-ae3c-9fe478d0505b tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] 10.222.0.86 "GET /compute/v2.1/servers/88ed5c44-308f-42a6-86ca-9b4e58b3af9b" status: 200 len: 1266 microversion: 2.1 time: 0.082029 Jul 28 18:14:06.316392 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 127/246] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:06 2022] GET /compute/v2.1/servers/88ed5c44-308f-42a6-86ca-9b4e58b3af9b => generated 1266 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:06.657118 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-87b4fd8e-8b38-497c-a26f-a0409e79890a tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:06.657795 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-87b4fd8e-8b38-497c-a26f-a0409e79890a tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:06.663866 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-87b4fd8e-8b38-497c-a26f-a0409e79890a tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:06.664386 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-87b4fd8e-8b38-497c-a26f-a0409e79890a tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:06.665343 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-87b4fd8e-8b38-497c-a26f-a0409e79890a tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:06.665861 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-87b4fd8e-8b38-497c-a26f-a0409e79890a tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:06.800927 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-87b4fd8e-8b38-497c-a26f-a0409e79890a tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:06.809546 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-87b4fd8e-8b38-497c-a26f-a0409e79890a tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1523 microversion: 2.1 time: 0.156228 Jul 28 18:14:06.810156 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 120/247] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:06 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:07.346025 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-c47569a9-d13d-43f6-b537-9d48dbb0ad80 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:07.346025 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-c47569a9-d13d-43f6-b537-9d48dbb0ad80 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] [instance: 88ed5c44-308f-42a6-86ca-9b4e58b3af9b] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:07.346025 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c47569a9-d13d-43f6-b537-9d48dbb0ad80 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:07.354019 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c47569a9-d13d-43f6-b537-9d48dbb0ad80 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:07.355212 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c47569a9-d13d-43f6-b537-9d48dbb0ad80 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:07.355661 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c47569a9-d13d-43f6-b537-9d48dbb0ad80 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:07.441908 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-c47569a9-d13d-43f6-b537-9d48dbb0ad80 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a794c5d63c0f499db264113d64ae63b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d8da2c21474c958de9039caa0b547d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:07.450044 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-c47569a9-d13d-43f6-b537-9d48dbb0ad80 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] 10.222.0.86 "GET /compute/v2.1/servers/88ed5c44-308f-42a6-86ca-9b4e58b3af9b" status: 200 len: 1284 microversion: 2.1 time: 0.120919 Jul 28 18:14:07.450618 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 128/248] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:07 2022] GET /compute/v2.1/servers/88ed5c44-308f-42a6-86ca-9b4e58b3af9b => generated 1284 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:07.838381 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-fa2b27f9-7399-4e7b-b24c-5904e211115e tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:07.838381 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-fa2b27f9-7399-4e7b-b24c-5904e211115e tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:07.851680 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fa2b27f9-7399-4e7b-b24c-5904e211115e tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:07.852137 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fa2b27f9-7399-4e7b-b24c-5904e211115e tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:07.852919 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fa2b27f9-7399-4e7b-b24c-5904e211115e tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:07.853409 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fa2b27f9-7399-4e7b-b24c-5904e211115e tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:08.055619 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-fa2b27f9-7399-4e7b-b24c-5904e211115e tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:08.063579 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-fa2b27f9-7399-4e7b-b24c-5904e211115e tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1523 microversion: 2.1 time: 0.235182 Jul 28 18:14:08.076826 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 121/249] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:07 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1523 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:08.474227 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-c2ffc91f-c732-4865-9b4d-7a021454e3f2 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:08.474841 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-c2ffc91f-c732-4865-9b4d-7a021454e3f2 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] [instance: 88ed5c44-308f-42a6-86ca-9b4e58b3af9b] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:08.482411 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c2ffc91f-c732-4865-9b4d-7a021454e3f2 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:08.483031 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c2ffc91f-c732-4865-9b4d-7a021454e3f2 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:08.483960 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c2ffc91f-c732-4865-9b4d-7a021454e3f2 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:08.484402 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c2ffc91f-c732-4865-9b4d-7a021454e3f2 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:08.657876 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-c2ffc91f-c732-4865-9b4d-7a021454e3f2 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a794c5d63c0f499db264113d64ae63b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d8da2c21474c958de9039caa0b547d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:08.665740 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-c2ffc91f-c732-4865-9b4d-7a021454e3f2 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] 10.222.0.86 "GET /compute/v2.1/servers/88ed5c44-308f-42a6-86ca-9b4e58b3af9b" status: 200 len: 1314 microversion: 2.1 time: 0.195383 Jul 28 18:14:08.666316 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 129/250] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:08 2022] GET /compute/v2.1/servers/88ed5c44-308f-42a6-86ca-9b4e58b3af9b => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:09.035505 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-231f84b7-be63-4b38-9d99-172bcd388d50 req-62317013-87a7-45fc-874e-08295a535245 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88ed5c44-308f-42a6-86ca-9b4e58b3af9b", "tag": "9970c139-713a-4a09-a5db-ae9b44549c10"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:14:09.053129 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-231f84b7-be63-4b38-9d99-172bcd388d50 req-62317013-87a7-45fc-874e-08295a535245 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:09.053129 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-231f84b7-be63-4b38-9d99-172bcd388d50 req-62317013-87a7-45fc-874e-08295a535245 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:09.064057 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-231f84b7-be63-4b38-9d99-172bcd388d50 req-62317013-87a7-45fc-874e-08295a535245 service nova] Creating event network-changed:9970c139-713a-4a09-a5db-ae9b44549c10 for instance 88ed5c44-308f-42a6-86ca-9b4e58b3af9b on hv-cinder-84617 Jul 28 18:14:09.069563 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-231f84b7-be63-4b38-9d99-172bcd388d50 req-62317013-87a7-45fc-874e-08295a535245 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037517 Jul 28 18:14:09.070668 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 122/251] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:14:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 18:14:09.084112 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-ca1f4579-7f8b-4426-b3b2-418149ad230e tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:09.084725 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-ca1f4579-7f8b-4426-b3b2-418149ad230e tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:09.091328 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ca1f4579-7f8b-4426-b3b2-418149ad230e tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:09.092045 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ca1f4579-7f8b-4426-b3b2-418149ad230e tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:09.092813 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ca1f4579-7f8b-4426-b3b2-418149ad230e tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:09.093294 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ca1f4579-7f8b-4426-b3b2-418149ad230e tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:09.307262 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-ca1f4579-7f8b-4426-b3b2-418149ad230e tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:09.314809 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-ca1f4579-7f8b-4426-b3b2-418149ad230e tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1523 microversion: 2.1 time: 0.234924 Jul 28 18:14:09.315316 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 130/252] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:09 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1523 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:09.686492 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-cbfdb490-1303-4ade-aa64-0ac7c6951cb7 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:09.687216 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-cbfdb490-1303-4ade-aa64-0ac7c6951cb7 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] [instance: 88ed5c44-308f-42a6-86ca-9b4e58b3af9b] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:09.693493 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cbfdb490-1303-4ade-aa64-0ac7c6951cb7 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:09.693945 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cbfdb490-1303-4ade-aa64-0ac7c6951cb7 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:09.694717 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cbfdb490-1303-4ade-aa64-0ac7c6951cb7 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:09.695245 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cbfdb490-1303-4ade-aa64-0ac7c6951cb7 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:09.904185 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-cbfdb490-1303-4ade-aa64-0ac7c6951cb7 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a794c5d63c0f499db264113d64ae63b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d8da2c21474c958de9039caa0b547d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:09.911784 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-cbfdb490-1303-4ade-aa64-0ac7c6951cb7 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] 10.222.0.86 "GET /compute/v2.1/servers/88ed5c44-308f-42a6-86ca-9b4e58b3af9b" status: 200 len: 1314 microversion: 2.1 time: 0.229580 Jul 28 18:14:09.912362 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 123/253] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:09 2022] GET /compute/v2.1/servers/88ed5c44-308f-42a6-86ca-9b4e58b3af9b => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:10.336347 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-f6c81fed-4b77-4ef7-bffa-2dd130d3b104 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:10.337006 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-f6c81fed-4b77-4ef7-bffa-2dd130d3b104 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:10.338812 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell0:SELECT=2 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:14:10.340122 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell0:SELECT=8 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:14:10.345272 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f6c81fed-4b77-4ef7-bffa-2dd130d3b104 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:10.347203 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f6c81fed-4b77-4ef7-bffa-2dd130d3b104 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:10.347203 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f6c81fed-4b77-4ef7-bffa-2dd130d3b104 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:10.347203 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f6c81fed-4b77-4ef7-bffa-2dd130d3b104 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:10.482858 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-f6c81fed-4b77-4ef7-bffa-2dd130d3b104 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:10.490894 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-f6c81fed-4b77-4ef7-bffa-2dd130d3b104 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1523 microversion: 2.1 time: 0.159250 Jul 28 18:14:10.492444 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 131/254] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:10 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:10.935741 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b701aad0-ee26-4256-b98e-86944b6767db tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:10.937029 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b701aad0-ee26-4256-b98e-86944b6767db tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] [instance: 88ed5c44-308f-42a6-86ca-9b4e58b3af9b] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:10.944453 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b701aad0-ee26-4256-b98e-86944b6767db tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:10.946495 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b701aad0-ee26-4256-b98e-86944b6767db tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:10.947271 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b701aad0-ee26-4256-b98e-86944b6767db tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:10.947710 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b701aad0-ee26-4256-b98e-86944b6767db tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:11.080776 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b701aad0-ee26-4256-b98e-86944b6767db tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a794c5d63c0f499db264113d64ae63b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d8da2c21474c958de9039caa0b547d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:11.089437 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b701aad0-ee26-4256-b98e-86944b6767db tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] 10.222.0.86 "GET /compute/v2.1/servers/88ed5c44-308f-42a6-86ca-9b4e58b3af9b" status: 200 len: 1314 microversion: 2.1 time: 0.159698 Jul 28 18:14:11.093250 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 124/255] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:10 2022] GET /compute/v2.1/servers/88ed5c44-308f-42a6-86ca-9b4e58b3af9b => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:14:11.511469 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-7ca9ce1f-d815-47ba-af40-86e937e95cd0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:11.512187 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-7ca9ce1f-d815-47ba-af40-86e937e95cd0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:11.518566 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-7ca9ce1f-d815-47ba-af40-86e937e95cd0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:11.519025 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-7ca9ce1f-d815-47ba-af40-86e937e95cd0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:11.519797 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-7ca9ce1f-d815-47ba-af40-86e937e95cd0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:11.520240 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-7ca9ce1f-d815-47ba-af40-86e937e95cd0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:11.672836 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-7ca9ce1f-d815-47ba-af40-86e937e95cd0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:11.682934 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-7ca9ce1f-d815-47ba-af40-86e937e95cd0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1523 microversion: 2.1 time: 0.175204 Jul 28 18:14:11.683516 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 132/256] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:11 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:12.114594 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-584ec4a7-727e-4b97-b2bc-0a658f6807e3 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:12.115214 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-584ec4a7-727e-4b97-b2bc-0a658f6807e3 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] [instance: 88ed5c44-308f-42a6-86ca-9b4e58b3af9b] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:12.122235 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-584ec4a7-727e-4b97-b2bc-0a658f6807e3 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:12.123129 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-584ec4a7-727e-4b97-b2bc-0a658f6807e3 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:12.124124 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-584ec4a7-727e-4b97-b2bc-0a658f6807e3 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:12.124576 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-584ec4a7-727e-4b97-b2bc-0a658f6807e3 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:12.261357 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-584ec4a7-727e-4b97-b2bc-0a658f6807e3 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a794c5d63c0f499db264113d64ae63b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d8da2c21474c958de9039caa0b547d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:12.269169 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-584ec4a7-727e-4b97-b2bc-0a658f6807e3 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] 10.222.0.86 "GET /compute/v2.1/servers/88ed5c44-308f-42a6-86ca-9b4e58b3af9b" status: 200 len: 1314 microversion: 2.1 time: 0.158468 Jul 28 18:14:12.269743 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 125/257] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:12 2022] GET /compute/v2.1/servers/88ed5c44-308f-42a6-86ca-9b4e58b3af9b => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:12.711151 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-96b9ef9b-a773-46fa-8bef-fbef6b58fb3b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:12.712015 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-96b9ef9b-a773-46fa-8bef-fbef6b58fb3b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:12.719550 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-96b9ef9b-a773-46fa-8bef-fbef6b58fb3b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:12.720005 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-96b9ef9b-a773-46fa-8bef-fbef6b58fb3b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:12.720819 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-96b9ef9b-a773-46fa-8bef-fbef6b58fb3b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:12.721292 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-96b9ef9b-a773-46fa-8bef-fbef6b58fb3b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:12.894311 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-96b9ef9b-a773-46fa-8bef-fbef6b58fb3b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:12.903317 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-96b9ef9b-a773-46fa-8bef-fbef6b58fb3b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1523 microversion: 2.1 time: 0.196081 Jul 28 18:14:12.912509 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 133/258] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:12 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1523 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:13.291026 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-1a6cee03-1abf-4f76-9f1e-75cb42f51272 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:13.291754 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-1a6cee03-1abf-4f76-9f1e-75cb42f51272 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] [instance: 88ed5c44-308f-42a6-86ca-9b4e58b3af9b] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:13.297701 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1a6cee03-1abf-4f76-9f1e-75cb42f51272 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:13.298154 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1a6cee03-1abf-4f76-9f1e-75cb42f51272 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:13.298930 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1a6cee03-1abf-4f76-9f1e-75cb42f51272 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:13.299418 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1a6cee03-1abf-4f76-9f1e-75cb42f51272 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:13.303332 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:14:13.452252 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-1a6cee03-1abf-4f76-9f1e-75cb42f51272 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a794c5d63c0f499db264113d64ae63b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d8da2c21474c958de9039caa0b547d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:13.479354 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-1a6cee03-1abf-4f76-9f1e-75cb42f51272 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] 10.222.0.86 "GET /compute/v2.1/servers/88ed5c44-308f-42a6-86ca-9b4e58b3af9b" status: 200 len: 1314 microversion: 2.1 time: 0.184916 Jul 28 18:14:13.479354 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 126/259] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:13 2022] GET /compute/v2.1/servers/88ed5c44-308f-42a6-86ca-9b4e58b3af9b => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:13.924159 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-9c7aba83-50be-4d57-9fe5-859437b45db0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:13.924779 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-9c7aba83-50be-4d57-9fe5-859437b45db0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:13.931937 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-9c7aba83-50be-4d57-9fe5-859437b45db0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:13.932401 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-9c7aba83-50be-4d57-9fe5-859437b45db0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:13.933211 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-9c7aba83-50be-4d57-9fe5-859437b45db0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:13.933650 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-9c7aba83-50be-4d57-9fe5-859437b45db0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:14.078290 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-9c7aba83-50be-4d57-9fe5-859437b45db0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:14.086393 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-9c7aba83-50be-4d57-9fe5-859437b45db0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1523 microversion: 2.1 time: 0.166135 Jul 28 18:14:14.086960 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 134/260] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:13 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:14.498811 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-cad2b087-28ce-4d41-baa5-dc6d488f1992 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:14.499412 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-cad2b087-28ce-4d41-baa5-dc6d488f1992 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] [instance: 88ed5c44-308f-42a6-86ca-9b4e58b3af9b] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:14.506669 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cad2b087-28ce-4d41-baa5-dc6d488f1992 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:14.506669 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cad2b087-28ce-4d41-baa5-dc6d488f1992 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:14.507357 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cad2b087-28ce-4d41-baa5-dc6d488f1992 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:14.508354 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cad2b087-28ce-4d41-baa5-dc6d488f1992 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:14.712857 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-cad2b087-28ce-4d41-baa5-dc6d488f1992 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a794c5d63c0f499db264113d64ae63b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d8da2c21474c958de9039caa0b547d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:14.732173 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-cad2b087-28ce-4d41-baa5-dc6d488f1992 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] 10.222.0.86 "GET /compute/v2.1/servers/88ed5c44-308f-42a6-86ca-9b4e58b3af9b" status: 200 len: 1314 microversion: 2.1 time: 0.237335 Jul 28 18:14:14.735326 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 127/261] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:14 2022] GET /compute/v2.1/servers/88ed5c44-308f-42a6-86ca-9b4e58b3af9b => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:15.107828 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-0e79abf4-fa6c-4c1f-8167-e54b0ac5dc26 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:15.108546 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-0e79abf4-fa6c-4c1f-8167-e54b0ac5dc26 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:15.114753 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-0e79abf4-fa6c-4c1f-8167-e54b0ac5dc26 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:15.115199 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-0e79abf4-fa6c-4c1f-8167-e54b0ac5dc26 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:15.115950 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-0e79abf4-fa6c-4c1f-8167-e54b0ac5dc26 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:15.116383 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-0e79abf4-fa6c-4c1f-8167-e54b0ac5dc26 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:15.121725 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell1:SELECT=100 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:14:15.272634 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-0e79abf4-fa6c-4c1f-8167-e54b0ac5dc26 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:15.287460 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-0e79abf4-fa6c-4c1f-8167-e54b0ac5dc26 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1523 microversion: 2.1 time: 0.183395 Jul 28 18:14:15.288414 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 135/262] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:15 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1523 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:15.752940 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-71fc74ac-728b-43cf-b8bd-3f7f943eb2b1 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:15.754130 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-71fc74ac-728b-43cf-b8bd-3f7f943eb2b1 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] [instance: 88ed5c44-308f-42a6-86ca-9b4e58b3af9b] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:15.760466 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-71fc74ac-728b-43cf-b8bd-3f7f943eb2b1 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:15.761122 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-71fc74ac-728b-43cf-b8bd-3f7f943eb2b1 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:15.762325 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-71fc74ac-728b-43cf-b8bd-3f7f943eb2b1 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:15.762918 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-71fc74ac-728b-43cf-b8bd-3f7f943eb2b1 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:15.905016 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-71fc74ac-728b-43cf-b8bd-3f7f943eb2b1 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a794c5d63c0f499db264113d64ae63b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d8da2c21474c958de9039caa0b547d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:15.914979 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-71fc74ac-728b-43cf-b8bd-3f7f943eb2b1 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] 10.222.0.86 "GET /compute/v2.1/servers/88ed5c44-308f-42a6-86ca-9b4e58b3af9b" status: 200 len: 1314 microversion: 2.1 time: 0.163515 Jul 28 18:14:15.914979 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 128/263] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:15 2022] GET /compute/v2.1/servers/88ed5c44-308f-42a6-86ca-9b4e58b3af9b => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:14:16.084297 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [req-f36bed7d-c749-42f2-91e2-1758bd2146fe req-7a221b58-92a1-41df-9868-8efcf7dd8926 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88ed5c44-308f-42a6-86ca-9b4e58b3af9b", "name": "network-vif-plugged", "status": "completed", "tag": "9970c139-713a-4a09-a5db-ae9b44549c10"}]} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:14:16.097973 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-f36bed7d-c749-42f2-91e2-1758bd2146fe req-7a221b58-92a1-41df-9868-8efcf7dd8926 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:16.103390 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-f36bed7d-c749-42f2-91e2-1758bd2146fe req-7a221b58-92a1-41df-9868-8efcf7dd8926 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:16.110271 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.compute.server_external_events [req-f36bed7d-c749-42f2-91e2-1758bd2146fe req-7a221b58-92a1-41df-9868-8efcf7dd8926 service nova] Creating event network-vif-plugged:9970c139-713a-4a09-a5db-ae9b44549c10 for instance 88ed5c44-308f-42a6-86ca-9b4e58b3af9b on hv-cinder-84617 Jul 28 18:14:16.115366 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [req-f36bed7d-c749-42f2-91e2-1758bd2146fe req-7a221b58-92a1-41df-9868-8efcf7dd8926 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035248 Jul 28 18:14:16.116305 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 136/264] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:14:16.308700 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0e35500f-9a97-4b7a-89b9-42ea3ef0b553 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:16.309612 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0e35500f-9a97-4b7a-89b9-42ea3ef0b553 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:16.318633 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0e35500f-9a97-4b7a-89b9-42ea3ef0b553 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:16.319373 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0e35500f-9a97-4b7a-89b9-42ea3ef0b553 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:16.320879 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0e35500f-9a97-4b7a-89b9-42ea3ef0b553 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:16.321410 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0e35500f-9a97-4b7a-89b9-42ea3ef0b553 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:16.456127 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-0e35500f-9a97-4b7a-89b9-42ea3ef0b553 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:16.469887 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0e35500f-9a97-4b7a-89b9-42ea3ef0b553 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1523 microversion: 2.1 time: 0.165159 Jul 28 18:14:16.470412 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 129/265] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:16 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:16.793355 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-4b298016-4e8e-4b0a-998c-bb1bae269a90 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:16.794263 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-4b298016-4e8e-4b0a-998c-bb1bae269a90 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:16.805935 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-4b298016-4e8e-4b0a-998c-bb1bae269a90 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:16.806487 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-4b298016-4e8e-4b0a-998c-bb1bae269a90 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:16.808944 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-4b298016-4e8e-4b0a-998c-bb1bae269a90 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:16.809429 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-4b298016-4e8e-4b0a-998c-bb1bae269a90 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:16.848670 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-4b298016-4e8e-4b0a-998c-bb1bae269a90 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Going to try to terminate instance {{(pid=118454) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 18:14:16.934984 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b43a9871-984b-4a9e-938e-1ae88e09b155 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:16.935601 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b43a9871-984b-4a9e-938e-1ae88e09b155 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] [instance: 88ed5c44-308f-42a6-86ca-9b4e58b3af9b] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:16.941949 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b43a9871-984b-4a9e-938e-1ae88e09b155 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:16.942404 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b43a9871-984b-4a9e-938e-1ae88e09b155 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:16.948860 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b43a9871-984b-4a9e-938e-1ae88e09b155 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:16.948860 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b43a9871-984b-4a9e-938e-1ae88e09b155 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:17.074045 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b43a9871-984b-4a9e-938e-1ae88e09b155 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a794c5d63c0f499db264113d64ae63b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d8da2c21474c958de9039caa0b547d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:17.081933 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b43a9871-984b-4a9e-938e-1ae88e09b155 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] 10.222.0.86 "GET /compute/v2.1/servers/88ed5c44-308f-42a6-86ca-9b4e58b3af9b" status: 200 len: 1314 microversion: 2.1 time: 0.151722 Jul 28 18:14:17.082512 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 130/266] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:16 2022] GET /compute/v2.1/servers/88ed5c44-308f-42a6-86ca-9b4e58b3af9b => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:14:17.229035 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-4b298016-4e8e-4b0a-998c-bb1bae269a90 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "DELETE /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436" status: 204 len: 0 microversion: 2.1 time: 0.443474 Jul 28 18:14:17.229611 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 137/267] 10.222.0.86 () {58 vars in 1239 bytes} [Thu Jul 28 18:14:16 2022] DELETE /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 18:14:17.237606 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-2cac16e1-5fdf-4048-948f-1be452265cdb tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:17.241419 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-2cac16e1-5fdf-4048-948f-1be452265cdb tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:17.244353 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2cac16e1-5fdf-4048-948f-1be452265cdb tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:17.244814 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2cac16e1-5fdf-4048-948f-1be452265cdb tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:17.245655 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2cac16e1-5fdf-4048-948f-1be452265cdb tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:17.246093 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2cac16e1-5fdf-4048-948f-1be452265cdb tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:17.411155 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-2cac16e1-5fdf-4048-948f-1be452265cdb tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96e9a9e40c54b6a9a7f8560e4846be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef52881d75f407a942bf960230ea22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:17.426413 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-2cac16e1-5fdf-4048-948f-1be452265cdb tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436" status: 200 len: 1551 microversion: 2.1 time: 0.192445 Jul 28 18:14:17.427392 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 131/268] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:17 2022] GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 => generated 1551 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:17.492304 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-2fe0f7a0-0c82-42e9-bd7b-09ff1d31f0f1 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:17.493039 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-2fe0f7a0-0c82-42e9-bd7b-09ff1d31f0f1 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:17.500115 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2fe0f7a0-0c82-42e9-bd7b-09ff1d31f0f1 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:17.500568 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2fe0f7a0-0c82-42e9-bd7b-09ff1d31f0f1 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:17.501360 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2fe0f7a0-0c82-42e9-bd7b-09ff1d31f0f1 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:17.501803 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2fe0f7a0-0c82-42e9-bd7b-09ff1d31f0f1 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:17.645099 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-2fe0f7a0-0c82-42e9-bd7b-09ff1d31f0f1 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:17.654479 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-2fe0f7a0-0c82-42e9-bd7b-09ff1d31f0f1 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1523 microversion: 2.1 time: 0.166468 Jul 28 18:14:17.655058 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 138/269] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:17 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:18.103832 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b74efcb3-5bb0-4405-9224-65a6b85c8611 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:18.104452 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b74efcb3-5bb0-4405-9224-65a6b85c8611 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] [instance: 88ed5c44-308f-42a6-86ca-9b4e58b3af9b] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:18.110634 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b74efcb3-5bb0-4405-9224-65a6b85c8611 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:18.111089 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b74efcb3-5bb0-4405-9224-65a6b85c8611 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:18.111852 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b74efcb3-5bb0-4405-9224-65a6b85c8611 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:18.112294 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b74efcb3-5bb0-4405-9224-65a6b85c8611 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:18.257376 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b74efcb3-5bb0-4405-9224-65a6b85c8611 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a794c5d63c0f499db264113d64ae63b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d8da2c21474c958de9039caa0b547d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:18.265042 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b74efcb3-5bb0-4405-9224-65a6b85c8611 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] 10.222.0.86 "GET /compute/v2.1/servers/88ed5c44-308f-42a6-86ca-9b4e58b3af9b" status: 200 len: 1314 microversion: 2.1 time: 0.165081 Jul 28 18:14:18.265626 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 132/270] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:18 2022] GET /compute/v2.1/servers/88ed5c44-308f-42a6-86ca-9b4e58b3af9b => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:18.447193 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-e20cece4-935b-4d3b-8438-3d373f559776 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:18.451810 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-e20cece4-935b-4d3b-8438-3d373f559776 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:18.454231 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e20cece4-935b-4d3b-8438-3d373f559776 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:18.454579 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e20cece4-935b-4d3b-8438-3d373f559776 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:18.455335 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e20cece4-935b-4d3b-8438-3d373f559776 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:18.455771 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e20cece4-935b-4d3b-8438-3d373f559776 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:18.583709 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-e20cece4-935b-4d3b-8438-3d373f559776 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96e9a9e40c54b6a9a7f8560e4846be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef52881d75f407a942bf960230ea22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:18.593124 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-e20cece4-935b-4d3b-8438-3d373f559776 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436" status: 200 len: 1551 microversion: 2.1 time: 0.149744 Jul 28 18:14:18.593770 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 139/271] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:18 2022] GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 => generated 1551 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:18.675487 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b54c6899-106b-401b-8cd4-b276adaf676f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:18.676095 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b54c6899-106b-401b-8cd4-b276adaf676f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:18.682303 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b54c6899-106b-401b-8cd4-b276adaf676f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:18.682757 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b54c6899-106b-401b-8cd4-b276adaf676f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:18.683529 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b54c6899-106b-401b-8cd4-b276adaf676f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:18.683968 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b54c6899-106b-401b-8cd4-b276adaf676f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:18.815790 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b54c6899-106b-401b-8cd4-b276adaf676f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:18.824222 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b54c6899-106b-401b-8cd4-b276adaf676f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1523 microversion: 2.1 time: 0.152726 Jul 28 18:14:18.824792 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 133/272] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:18 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:19.287043 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-143f725f-9cdf-468c-a2e2-ce8c4d76f5e9 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:19.287658 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-143f725f-9cdf-468c-a2e2-ce8c4d76f5e9 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] [instance: 88ed5c44-308f-42a6-86ca-9b4e58b3af9b] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:19.294396 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-143f725f-9cdf-468c-a2e2-ce8c4d76f5e9 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:19.294835 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-143f725f-9cdf-468c-a2e2-ce8c4d76f5e9 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:19.295593 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-143f725f-9cdf-468c-a2e2-ce8c4d76f5e9 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:19.296021 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-143f725f-9cdf-468c-a2e2-ce8c4d76f5e9 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:19.440350 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-143f725f-9cdf-468c-a2e2-ce8c4d76f5e9 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a794c5d63c0f499db264113d64ae63b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d8da2c21474c958de9039caa0b547d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:19.447924 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-143f725f-9cdf-468c-a2e2-ce8c4d76f5e9 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] 10.222.0.86 "GET /compute/v2.1/servers/88ed5c44-308f-42a6-86ca-9b4e58b3af9b" status: 200 len: 1314 microversion: 2.1 time: 0.165114 Jul 28 18:14:19.448515 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 140/273] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:19 2022] GET /compute/v2.1/servers/88ed5c44-308f-42a6-86ca-9b4e58b3af9b => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:14:19.614442 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-345a7391-d7ff-4c6e-88e0-eefbbc357f35 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:19.615058 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-345a7391-d7ff-4c6e-88e0-eefbbc357f35 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:19.621290 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-345a7391-d7ff-4c6e-88e0-eefbbc357f35 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:19.623456 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-345a7391-d7ff-4c6e-88e0-eefbbc357f35 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:19.623456 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-345a7391-d7ff-4c6e-88e0-eefbbc357f35 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:19.623456 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-345a7391-d7ff-4c6e-88e0-eefbbc357f35 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:19.756901 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-345a7391-d7ff-4c6e-88e0-eefbbc357f35 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96e9a9e40c54b6a9a7f8560e4846be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef52881d75f407a942bf960230ea22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:19.765406 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-345a7391-d7ff-4c6e-88e0-eefbbc357f35 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436" status: 200 len: 1551 microversion: 2.1 time: 0.154793 Jul 28 18:14:19.765979 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 134/274] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:19 2022] GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 => generated 1551 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:19.844640 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-1deb99ec-a02d-46c8-bf9d-f113104bfa84 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:19.845274 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-1deb99ec-a02d-46c8-bf9d-f113104bfa84 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:19.852574 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-1deb99ec-a02d-46c8-bf9d-f113104bfa84 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:19.853047 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-1deb99ec-a02d-46c8-bf9d-f113104bfa84 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:19.853816 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-1deb99ec-a02d-46c8-bf9d-f113104bfa84 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:19.854253 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-1deb99ec-a02d-46c8-bf9d-f113104bfa84 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:19.988004 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-1deb99ec-a02d-46c8-bf9d-f113104bfa84 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:19.995668 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-1deb99ec-a02d-46c8-bf9d-f113104bfa84 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1523 microversion: 2.1 time: 0.155105 Jul 28 18:14:19.996253 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 141/275] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:19 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:20.469666 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-af16ffc0-e673-4ef4-8ec1-d88ad0b1776a tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:20.470277 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-af16ffc0-e673-4ef4-8ec1-d88ad0b1776a tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] [instance: 88ed5c44-308f-42a6-86ca-9b4e58b3af9b] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:20.476924 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-af16ffc0-e673-4ef4-8ec1-d88ad0b1776a tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:20.477387 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-af16ffc0-e673-4ef4-8ec1-d88ad0b1776a tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:20.478171 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-af16ffc0-e673-4ef4-8ec1-d88ad0b1776a tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:20.478600 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-af16ffc0-e673-4ef4-8ec1-d88ad0b1776a tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:20.607241 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-af16ffc0-e673-4ef4-8ec1-d88ad0b1776a tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a794c5d63c0f499db264113d64ae63b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d8da2c21474c958de9039caa0b547d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:20.614738 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-af16ffc0-e673-4ef4-8ec1-d88ad0b1776a tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] 10.222.0.86 "GET /compute/v2.1/servers/88ed5c44-308f-42a6-86ca-9b4e58b3af9b" status: 200 len: 1314 microversion: 2.1 time: 0.149267 Jul 28 18:14:20.622430 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 135/276] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:20 2022] GET /compute/v2.1/servers/88ed5c44-308f-42a6-86ca-9b4e58b3af9b => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:20.787146 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-829b0795-5dbd-4f45-aa7a-dfd23a1276fd tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:20.787679 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-829b0795-5dbd-4f45-aa7a-dfd23a1276fd tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:20.794662 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-829b0795-5dbd-4f45-aa7a-dfd23a1276fd tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:20.795146 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-829b0795-5dbd-4f45-aa7a-dfd23a1276fd tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:20.795921 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-829b0795-5dbd-4f45-aa7a-dfd23a1276fd tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:20.796389 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-829b0795-5dbd-4f45-aa7a-dfd23a1276fd tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:20.930397 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-829b0795-5dbd-4f45-aa7a-dfd23a1276fd tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96e9a9e40c54b6a9a7f8560e4846be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef52881d75f407a942bf960230ea22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:20.938476 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-829b0795-5dbd-4f45-aa7a-dfd23a1276fd tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436" status: 200 len: 1551 microversion: 2.1 time: 0.155186 Jul 28 18:14:20.938956 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 142/277] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:20 2022] GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 => generated 1551 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:21.016787 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-70a94f91-0968-498c-a363-1e3cdea73272 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:21.017421 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-70a94f91-0968-498c-a363-1e3cdea73272 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:21.023907 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-70a94f91-0968-498c-a363-1e3cdea73272 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:21.024363 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-70a94f91-0968-498c-a363-1e3cdea73272 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:21.025156 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-70a94f91-0968-498c-a363-1e3cdea73272 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:21.025599 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-70a94f91-0968-498c-a363-1e3cdea73272 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:21.151779 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-70a94f91-0968-498c-a363-1e3cdea73272 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:21.159652 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-70a94f91-0968-498c-a363-1e3cdea73272 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1523 microversion: 2.1 time: 0.146649 Jul 28 18:14:21.160227 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 136/278] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:21 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1523 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:21.638408 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-1075756f-fbce-4668-8ffa-a3dfb56f8405 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:21.638929 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-1075756f-fbce-4668-8ffa-a3dfb56f8405 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] [instance: 88ed5c44-308f-42a6-86ca-9b4e58b3af9b] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:21.644909 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-1075756f-fbce-4668-8ffa-a3dfb56f8405 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:21.645397 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-1075756f-fbce-4668-8ffa-a3dfb56f8405 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:21.646148 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-1075756f-fbce-4668-8ffa-a3dfb56f8405 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:21.646581 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-1075756f-fbce-4668-8ffa-a3dfb56f8405 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:21.905093 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-1075756f-fbce-4668-8ffa-a3dfb56f8405 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a794c5d63c0f499db264113d64ae63b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d8da2c21474c958de9039caa0b547d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:21.912669 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-1075756f-fbce-4668-8ffa-a3dfb56f8405 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] 10.222.0.86 "GET /compute/v2.1/servers/88ed5c44-308f-42a6-86ca-9b4e58b3af9b" status: 200 len: 1314 microversion: 2.1 time: 0.278209 Jul 28 18:14:21.913251 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 143/279] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:21 2022] GET /compute/v2.1/servers/88ed5c44-308f-42a6-86ca-9b4e58b3af9b => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:14:21.958399 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-2311711c-76ff-495a-8396-7e3d4dbef160 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:21.959029 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-2311711c-76ff-495a-8396-7e3d4dbef160 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:21.965243 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2311711c-76ff-495a-8396-7e3d4dbef160 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:21.965685 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2311711c-76ff-495a-8396-7e3d4dbef160 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:21.966687 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2311711c-76ff-495a-8396-7e3d4dbef160 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:21.967115 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2311711c-76ff-495a-8396-7e3d4dbef160 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:22.093922 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-2311711c-76ff-495a-8396-7e3d4dbef160 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96e9a9e40c54b6a9a7f8560e4846be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef52881d75f407a942bf960230ea22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:22.102221 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-2311711c-76ff-495a-8396-7e3d4dbef160 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436" status: 200 len: 1551 microversion: 2.1 time: 0.147580 Jul 28 18:14:22.102781 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 137/280] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:21 2022] GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 => generated 1551 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:22.182027 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-077822bd-328c-457e-9e54-7e83ddd5db10 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:22.182575 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-077822bd-328c-457e-9e54-7e83ddd5db10 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:22.188519 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-077822bd-328c-457e-9e54-7e83ddd5db10 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:22.188989 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-077822bd-328c-457e-9e54-7e83ddd5db10 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:22.189830 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-077822bd-328c-457e-9e54-7e83ddd5db10 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:22.190270 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-077822bd-328c-457e-9e54-7e83ddd5db10 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:22.318611 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-077822bd-328c-457e-9e54-7e83ddd5db10 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:22.328530 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-077822bd-328c-457e-9e54-7e83ddd5db10 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1523 microversion: 2.1 time: 0.151010 Jul 28 18:14:22.329224 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 144/281] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:22 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:22.932621 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3ed70243-4720-4ee8-b672-4392d030ac3d tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:22.933256 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3ed70243-4720-4ee8-b672-4392d030ac3d tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] [instance: 88ed5c44-308f-42a6-86ca-9b4e58b3af9b] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:22.939467 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3ed70243-4720-4ee8-b672-4392d030ac3d tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:22.939908 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3ed70243-4720-4ee8-b672-4392d030ac3d tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:22.940681 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3ed70243-4720-4ee8-b672-4392d030ac3d tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:22.941162 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3ed70243-4720-4ee8-b672-4392d030ac3d tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:23.074493 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-3ed70243-4720-4ee8-b672-4392d030ac3d tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a794c5d63c0f499db264113d64ae63b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d8da2c21474c958de9039caa0b547d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:23.082006 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-3ed70243-4720-4ee8-b672-4392d030ac3d tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] 10.222.0.86 "GET /compute/v2.1/servers/88ed5c44-308f-42a6-86ca-9b4e58b3af9b" status: 200 len: 1314 microversion: 2.1 time: 0.153304 Jul 28 18:14:23.082567 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 138/282] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:22 2022] GET /compute/v2.1/servers/88ed5c44-308f-42a6-86ca-9b4e58b3af9b => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:23.123482 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-b4f3fad9-141a-4fce-a1a8-f913b5496bcd tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:23.124092 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-b4f3fad9-141a-4fce-a1a8-f913b5496bcd tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:23.130542 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b4f3fad9-141a-4fce-a1a8-f913b5496bcd tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:23.130993 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b4f3fad9-141a-4fce-a1a8-f913b5496bcd tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:23.131762 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b4f3fad9-141a-4fce-a1a8-f913b5496bcd tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:23.132203 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b4f3fad9-141a-4fce-a1a8-f913b5496bcd tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:23.259379 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-b4f3fad9-141a-4fce-a1a8-f913b5496bcd tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96e9a9e40c54b6a9a7f8560e4846be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef52881d75f407a942bf960230ea22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:23.267335 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-b4f3fad9-141a-4fce-a1a8-f913b5496bcd tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436" status: 200 len: 1551 microversion: 2.1 time: 0.147698 Jul 28 18:14:23.267896 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 145/283] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:23 2022] GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 => generated 1551 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:14:23.357227 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-93c40b12-080e-4459-bd7c-d01a8ae3b15c tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:23.357869 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-93c40b12-080e-4459-bd7c-d01a8ae3b15c tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:23.364346 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-93c40b12-080e-4459-bd7c-d01a8ae3b15c tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:23.367525 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-93c40b12-080e-4459-bd7c-d01a8ae3b15c tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:23.367525 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-93c40b12-080e-4459-bd7c-d01a8ae3b15c tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:23.367525 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-93c40b12-080e-4459-bd7c-d01a8ae3b15c tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:23.505819 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-93c40b12-080e-4459-bd7c-d01a8ae3b15c tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:23.517185 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-93c40b12-080e-4459-bd7c-d01a8ae3b15c tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1523 microversion: 2.1 time: 0.161664 Jul 28 18:14:23.517185 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 139/284] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:23 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:24.103559 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-8676d494-5105-456b-a78c-d9fafe5390d4 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:24.104171 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-8676d494-5105-456b-a78c-d9fafe5390d4 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] [instance: 88ed5c44-308f-42a6-86ca-9b4e58b3af9b] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:24.110568 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-8676d494-5105-456b-a78c-d9fafe5390d4 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:24.111065 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-8676d494-5105-456b-a78c-d9fafe5390d4 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:24.111852 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-8676d494-5105-456b-a78c-d9fafe5390d4 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:24.112323 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-8676d494-5105-456b-a78c-d9fafe5390d4 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:24.247359 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-8676d494-5105-456b-a78c-d9fafe5390d4 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a794c5d63c0f499db264113d64ae63b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d8da2c21474c958de9039caa0b547d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:24.254862 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-8676d494-5105-456b-a78c-d9fafe5390d4 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] 10.222.0.86 "GET /compute/v2.1/servers/88ed5c44-308f-42a6-86ca-9b4e58b3af9b" status: 200 len: 1497 microversion: 2.1 time: 0.156046 Jul 28 18:14:24.255425 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 146/285] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:24 2022] GET /compute/v2.1/servers/88ed5c44-308f-42a6-86ca-9b4e58b3af9b => generated 1497 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:24.288509 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-91641932-64d0-47dd-a53c-7219a5bad223 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:24.289176 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-91641932-64d0-47dd-a53c-7219a5bad223 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:24.295144 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-91641932-64d0-47dd-a53c-7219a5bad223 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:24.295595 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-91641932-64d0-47dd-a53c-7219a5bad223 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:24.296358 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-91641932-64d0-47dd-a53c-7219a5bad223 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:24.296797 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-91641932-64d0-47dd-a53c-7219a5bad223 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:24.431818 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-91641932-64d0-47dd-a53c-7219a5bad223 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96e9a9e40c54b6a9a7f8560e4846be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef52881d75f407a942bf960230ea22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:24.439927 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-91641932-64d0-47dd-a53c-7219a5bad223 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436" status: 200 len: 1551 microversion: 2.1 time: 0.155537 Jul 28 18:14:24.440516 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 140/286] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:24 2022] GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 => generated 1551 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:24.545617 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-a0fc398f-e234-4359-9f9a-a01289b26861 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:24.546239 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-a0fc398f-e234-4359-9f9a-a01289b26861 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:24.552249 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a0fc398f-e234-4359-9f9a-a01289b26861 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:24.552707 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a0fc398f-e234-4359-9f9a-a01289b26861 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:24.553509 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a0fc398f-e234-4359-9f9a-a01289b26861 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:24.554010 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a0fc398f-e234-4359-9f9a-a01289b26861 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:24.705058 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-a0fc398f-e234-4359-9f9a-a01289b26861 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:24.712994 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-a0fc398f-e234-4359-9f9a-a01289b26861 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1523 microversion: 2.1 time: 0.174678 Jul 28 18:14:24.713570 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 147/287] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:24 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:25.462180 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0923ac46-a931-4910-9659-d694ba919b22 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:25.463031 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0923ac46-a931-4910-9659-d694ba919b22 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:25.470214 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0923ac46-a931-4910-9659-d694ba919b22 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:25.470675 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0923ac46-a931-4910-9659-d694ba919b22 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:25.471461 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0923ac46-a931-4910-9659-d694ba919b22 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:25.471909 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0923ac46-a931-4910-9659-d694ba919b22 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:25.675419 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-2e6b79b8-adb4-4d82-89c1-037df8dc1c8f tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:25.675956 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-2e6b79b8-adb4-4d82-89c1-037df8dc1c8f tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] [instance: 88ed5c44-308f-42a6-86ca-9b4e58b3af9b] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:25.683079 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2e6b79b8-adb4-4d82-89c1-037df8dc1c8f tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:25.683458 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2e6b79b8-adb4-4d82-89c1-037df8dc1c8f tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:25.684223 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2e6b79b8-adb4-4d82-89c1-037df8dc1c8f tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:25.684657 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2e6b79b8-adb4-4d82-89c1-037df8dc1c8f tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:25.715475 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-2e6b79b8-adb4-4d82-89c1-037df8dc1c8f tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] [instance: 88ed5c44-308f-42a6-86ca-9b4e58b3af9b] Going to try to terminate instance {{(pid=118454) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 18:14:25.745310 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-0923ac46-a931-4910-9659-d694ba919b22 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96e9a9e40c54b6a9a7f8560e4846be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef52881d75f407a942bf960230ea22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:25.759284 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0923ac46-a931-4910-9659-d694ba919b22 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436" status: 200 len: 1551 microversion: 2.1 time: 0.301633 Jul 28 18:14:25.759903 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 141/288] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:25 2022] GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 => generated 1551 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:25.765677 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-29e5597f-3fb1-452e-b4f5-0f8e72b3a4eb tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:25.770100 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-29e5597f-3fb1-452e-b4f5-0f8e72b3a4eb tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:25.774848 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-29e5597f-3fb1-452e-b4f5-0f8e72b3a4eb tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:25.775565 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-29e5597f-3fb1-452e-b4f5-0f8e72b3a4eb tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:25.776330 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-29e5597f-3fb1-452e-b4f5-0f8e72b3a4eb tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:25.776923 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-29e5597f-3fb1-452e-b4f5-0f8e72b3a4eb tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:25.999087 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-29e5597f-3fb1-452e-b4f5-0f8e72b3a4eb tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:26.001445 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:14:26.011658 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-29e5597f-3fb1-452e-b4f5-0f8e72b3a4eb tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1523 microversion: 2.1 time: 0.250572 Jul 28 18:14:26.012253 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 142/289] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:25 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1523 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:26.025164 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-404c452e-cf2c-4079-a512-993181e1f0a9 req-d743c2b6-24f3-43ba-b6db-a2acaf41a513 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b81a4ab-5e71-4dd6-bed5-1a068b1ca436", "name": "network-vif-deleted", "tag": "dc5628c1-5dbb-402d-9159-d05b64b9abb0"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:14:26.026285 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-404c452e-cf2c-4079-a512-993181e1f0a9 req-d743c2b6-24f3-43ba-b6db-a2acaf41a513 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:26.026739 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-404c452e-cf2c-4079-a512-993181e1f0a9 req-d743c2b6-24f3-43ba-b6db-a2acaf41a513 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:26.033846 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-2e6b79b8-adb4-4d82-89c1-037df8dc1c8f tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] 10.222.0.86 "DELETE /compute/v2.1/servers/88ed5c44-308f-42a6-86ca-9b4e58b3af9b" status: 204 len: 0 microversion: 2.1 time: 0.362056 Jul 28 18:14:26.034952 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 148/290] 10.222.0.86 () {58 vars in 1239 bytes} [Thu Jul 28 18:14:25 2022] DELETE /compute/v2.1/servers/88ed5c44-308f-42a6-86ca-9b4e58b3af9b => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 18:14:26.044809 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-404c452e-cf2c-4079-a512-993181e1f0a9 req-d743c2b6-24f3-43ba-b6db-a2acaf41a513 service nova] Creating event network-vif-deleted:dc5628c1-5dbb-402d-9159-d05b64b9abb0 for instance 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 on hv-cinder-84617 Jul 28 18:14:26.045383 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-a3d87f23-24b5-48a9-893c-110c243c2706 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:26.046082 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-a3d87f23-24b5-48a9-893c-110c243c2706 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] [instance: 88ed5c44-308f-42a6-86ca-9b4e58b3af9b] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:26.051194 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-404c452e-cf2c-4079-a512-993181e1f0a9 req-d743c2b6-24f3-43ba-b6db-a2acaf41a513 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037741 Jul 28 18:14:26.052327 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 143/291] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:14:26.057570 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a3d87f23-24b5-48a9-893c-110c243c2706 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:26.058021 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a3d87f23-24b5-48a9-893c-110c243c2706 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:26.058797 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a3d87f23-24b5-48a9-893c-110c243c2706 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:26.059232 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a3d87f23-24b5-48a9-893c-110c243c2706 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:26.063695 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:14:26.193313 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-a3d87f23-24b5-48a9-893c-110c243c2706 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a794c5d63c0f499db264113d64ae63b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d8da2c21474c958de9039caa0b547d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:26.200954 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-a3d87f23-24b5-48a9-893c-110c243c2706 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] 10.222.0.86 "GET /compute/v2.1/servers/88ed5c44-308f-42a6-86ca-9b4e58b3af9b" status: 200 len: 1503 microversion: 2.1 time: 0.159725 Jul 28 18:14:26.201759 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 149/292] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:26 2022] GET /compute/v2.1/servers/88ed5c44-308f-42a6-86ca-9b4e58b3af9b => generated 1503 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:26.783584 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0bb6f112-83cc-40f3-97ee-3cb6139e6a92 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:26.784272 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0bb6f112-83cc-40f3-97ee-3cb6139e6a92 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:26.791242 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0bb6f112-83cc-40f3-97ee-3cb6139e6a92 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:26.791968 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0bb6f112-83cc-40f3-97ee-3cb6139e6a92 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:26.792640 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0bb6f112-83cc-40f3-97ee-3cb6139e6a92 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:26.793106 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0bb6f112-83cc-40f3-97ee-3cb6139e6a92 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:26.868028 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-0bb6f112-83cc-40f3-97ee-3cb6139e6a92 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96e9a9e40c54b6a9a7f8560e4846be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef52881d75f407a942bf960230ea22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:26.880132 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0bb6f112-83cc-40f3-97ee-3cb6139e6a92 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436" status: 200 len: 1509 microversion: 2.1 time: 0.100707 Jul 28 18:14:26.880772 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 144/293] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:26 2022] GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 => generated 1509 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:27.033850 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-e4017242-eebd-4cf2-8eb9-adc6713ef4d8 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:27.034371 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-e4017242-eebd-4cf2-8eb9-adc6713ef4d8 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:27.041617 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e4017242-eebd-4cf2-8eb9-adc6713ef4d8 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:27.042065 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e4017242-eebd-4cf2-8eb9-adc6713ef4d8 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:27.042818 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e4017242-eebd-4cf2-8eb9-adc6713ef4d8 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:27.043249 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e4017242-eebd-4cf2-8eb9-adc6713ef4d8 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:27.171988 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-e4017242-eebd-4cf2-8eb9-adc6713ef4d8 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:27.180112 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-e4017242-eebd-4cf2-8eb9-adc6713ef4d8 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1523 microversion: 2.1 time: 0.149875 Jul 28 18:14:27.180677 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 150/294] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:27 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:27.223061 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-4f680f2c-8f24-4b6c-a9e1-e5358a10214d tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:27.224673 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-4f680f2c-8f24-4b6c-a9e1-e5358a10214d tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] [instance: 88ed5c44-308f-42a6-86ca-9b4e58b3af9b] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:27.230380 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4f680f2c-8f24-4b6c-a9e1-e5358a10214d tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:27.230833 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4f680f2c-8f24-4b6c-a9e1-e5358a10214d tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:27.231597 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4f680f2c-8f24-4b6c-a9e1-e5358a10214d tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:27.232038 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4f680f2c-8f24-4b6c-a9e1-e5358a10214d tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:27.494949 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-4f680f2c-8f24-4b6c-a9e1-e5358a10214d tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a794c5d63c0f499db264113d64ae63b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d8da2c21474c958de9039caa0b547d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:27.502369 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-4f680f2c-8f24-4b6c-a9e1-e5358a10214d tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] 10.222.0.86 "GET /compute/v2.1/servers/88ed5c44-308f-42a6-86ca-9b4e58b3af9b" status: 200 len: 1503 microversion: 2.1 time: 0.283176 Jul 28 18:14:27.502932 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 145/295] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:27 2022] GET /compute/v2.1/servers/88ed5c44-308f-42a6-86ca-9b4e58b3af9b => generated 1503 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:27.901554 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-fed0e822-1f39-4b87-ac6c-f7d77086c038 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:27.902158 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-fed0e822-1f39-4b87-ac6c-f7d77086c038 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:27.908177 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-fed0e822-1f39-4b87-ac6c-f7d77086c038 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:27.908627 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-fed0e822-1f39-4b87-ac6c-f7d77086c038 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:27.909401 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-fed0e822-1f39-4b87-ac6c-f7d77086c038 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:27.909835 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-fed0e822-1f39-4b87-ac6c-f7d77086c038 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:27.969331 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-fed0e822-1f39-4b87-ac6c-f7d77086c038 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96e9a9e40c54b6a9a7f8560e4846be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef52881d75f407a942bf960230ea22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:27.978144 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-fed0e822-1f39-4b87-ac6c-f7d77086c038 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436" status: 200 len: 1509 microversion: 2.1 time: 0.080562 Jul 28 18:14:27.978701 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 151/296] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:27 2022] GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 => generated 1509 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:28.200382 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-13f1f36b-9d46-464a-930a-62a677a4d25e tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:28.201018 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-13f1f36b-9d46-464a-930a-62a677a4d25e tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:28.206980 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-13f1f36b-9d46-464a-930a-62a677a4d25e tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:28.207432 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-13f1f36b-9d46-464a-930a-62a677a4d25e tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:28.208201 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-13f1f36b-9d46-464a-930a-62a677a4d25e tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:28.208642 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-13f1f36b-9d46-464a-930a-62a677a4d25e tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:28.338319 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-13f1f36b-9d46-464a-930a-62a677a4d25e tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:28.345941 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-13f1f36b-9d46-464a-930a-62a677a4d25e tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1523 microversion: 2.1 time: 0.149424 Jul 28 18:14:28.346514 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 146/297] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:28 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:28.523225 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-be07cb42-a599-4153-b48c-bcfbadfb3388 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:28.523829 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-be07cb42-a599-4153-b48c-bcfbadfb3388 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] [instance: 88ed5c44-308f-42a6-86ca-9b4e58b3af9b] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:28.530314 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-be07cb42-a599-4153-b48c-bcfbadfb3388 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:28.530773 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-be07cb42-a599-4153-b48c-bcfbadfb3388 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:28.531528 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-be07cb42-a599-4153-b48c-bcfbadfb3388 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:28.531965 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-be07cb42-a599-4153-b48c-bcfbadfb3388 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:28.665209 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-be07cb42-a599-4153-b48c-bcfbadfb3388 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a794c5d63c0f499db264113d64ae63b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d8da2c21474c958de9039caa0b547d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:28.672759 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-be07cb42-a599-4153-b48c-bcfbadfb3388 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] 10.222.0.86 "GET /compute/v2.1/servers/88ed5c44-308f-42a6-86ca-9b4e58b3af9b" status: 200 len: 1503 microversion: 2.1 time: 0.153391 Jul 28 18:14:28.673363 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 152/298] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:28 2022] GET /compute/v2.1/servers/88ed5c44-308f-42a6-86ca-9b4e58b3af9b => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:28.999094 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-8a1659b7-cf56-4a09-8c51-7cdc5f706fa4 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:28.999699 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-8a1659b7-cf56-4a09-8c51-7cdc5f706fa4 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:29.005934 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8a1659b7-cf56-4a09-8c51-7cdc5f706fa4 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:29.006394 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8a1659b7-cf56-4a09-8c51-7cdc5f706fa4 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:29.007164 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8a1659b7-cf56-4a09-8c51-7cdc5f706fa4 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:29.007610 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8a1659b7-cf56-4a09-8c51-7cdc5f706fa4 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:29.066807 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8a1659b7-cf56-4a09-8c51-7cdc5f706fa4 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96e9a9e40c54b6a9a7f8560e4846be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef52881d75f407a942bf960230ea22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:29.074768 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-8a1659b7-cf56-4a09-8c51-7cdc5f706fa4 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436" status: 200 len: 1509 microversion: 2.1 time: 0.079512 Jul 28 18:14:29.075362 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 147/299] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:28 2022] GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 => generated 1509 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:29.367021 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-e520d3be-7ff3-4a05-afd8-3143dd6b1bf1 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:29.367626 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-e520d3be-7ff3-4a05-afd8-3143dd6b1bf1 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:29.373640 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e520d3be-7ff3-4a05-afd8-3143dd6b1bf1 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:29.374087 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e520d3be-7ff3-4a05-afd8-3143dd6b1bf1 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:29.374845 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e520d3be-7ff3-4a05-afd8-3143dd6b1bf1 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:29.375285 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e520d3be-7ff3-4a05-afd8-3143dd6b1bf1 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:29.506485 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-e520d3be-7ff3-4a05-afd8-3143dd6b1bf1 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:29.514756 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-e520d3be-7ff3-4a05-afd8-3143dd6b1bf1 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1523 microversion: 2.1 time: 0.151612 Jul 28 18:14:29.515323 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 153/300] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:29 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:29.699350 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b1aed7f7-fd6f-4114-8b0d-32c7a417f4e1 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:29.700015 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b1aed7f7-fd6f-4114-8b0d-32c7a417f4e1 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] [instance: 88ed5c44-308f-42a6-86ca-9b4e58b3af9b] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:29.706048 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b1aed7f7-fd6f-4114-8b0d-32c7a417f4e1 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:29.706495 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b1aed7f7-fd6f-4114-8b0d-32c7a417f4e1 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:29.707253 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b1aed7f7-fd6f-4114-8b0d-32c7a417f4e1 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:29.707692 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b1aed7f7-fd6f-4114-8b0d-32c7a417f4e1 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:29.832942 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b1aed7f7-fd6f-4114-8b0d-32c7a417f4e1 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a794c5d63c0f499db264113d64ae63b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d8da2c21474c958de9039caa0b547d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:29.840778 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b1aed7f7-fd6f-4114-8b0d-32c7a417f4e1 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] 10.222.0.86 "GET /compute/v2.1/servers/88ed5c44-308f-42a6-86ca-9b4e58b3af9b" status: 200 len: 1503 microversion: 2.1 time: 0.150350 Jul 28 18:14:29.841631 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 148/301] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:29 2022] GET /compute/v2.1/servers/88ed5c44-308f-42a6-86ca-9b4e58b3af9b => generated 1503 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:14:30.095954 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-31ac17a6-bacc-4d39-8d8f-8a4cc87e92db tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:30.096559 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-31ac17a6-bacc-4d39-8d8f-8a4cc87e92db tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:30.103784 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-31ac17a6-bacc-4d39-8d8f-8a4cc87e92db tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:30.104234 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-31ac17a6-bacc-4d39-8d8f-8a4cc87e92db tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:30.105017 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-31ac17a6-bacc-4d39-8d8f-8a4cc87e92db tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:30.105475 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-31ac17a6-bacc-4d39-8d8f-8a4cc87e92db tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:30.165752 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-31ac17a6-bacc-4d39-8d8f-8a4cc87e92db tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96e9a9e40c54b6a9a7f8560e4846be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef52881d75f407a942bf960230ea22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:30.173583 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-31ac17a6-bacc-4d39-8d8f-8a4cc87e92db tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436" status: 200 len: 1509 microversion: 2.1 time: 0.081581 Jul 28 18:14:30.174146 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 154/302] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:30 2022] GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 => generated 1509 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:30.535473 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a15fdbdb-f22e-4c2f-9f19-80ac2b7ca254 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:30.536088 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-a15fdbdb-f22e-4c2f-9f19-80ac2b7ca254 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:30.542029 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a15fdbdb-f22e-4c2f-9f19-80ac2b7ca254 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:30.542483 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a15fdbdb-f22e-4c2f-9f19-80ac2b7ca254 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:30.544273 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a15fdbdb-f22e-4c2f-9f19-80ac2b7ca254 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:30.544273 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a15fdbdb-f22e-4c2f-9f19-80ac2b7ca254 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:30.695997 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-a15fdbdb-f22e-4c2f-9f19-80ac2b7ca254 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:30.704185 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-a15fdbdb-f22e-4c2f-9f19-80ac2b7ca254 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1523 microversion: 2.1 time: 0.172616 Jul 28 18:14:30.704775 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 149/303] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:30 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:30.861746 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-7f1977f7-13a7-4805-98c9-1cef31ef58fb tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:30.862355 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-7f1977f7-13a7-4805-98c9-1cef31ef58fb tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] [instance: 88ed5c44-308f-42a6-86ca-9b4e58b3af9b] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:30.864305 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=2 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:14:30.869754 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-7f1977f7-13a7-4805-98c9-1cef31ef58fb tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:30.870228 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-7f1977f7-13a7-4805-98c9-1cef31ef58fb tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:30.871027 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-7f1977f7-13a7-4805-98c9-1cef31ef58fb tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:30.871456 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-7f1977f7-13a7-4805-98c9-1cef31ef58fb tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:31.020918 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-7f1977f7-13a7-4805-98c9-1cef31ef58fb tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a794c5d63c0f499db264113d64ae63b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d8da2c21474c958de9039caa0b547d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:31.028811 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-7f1977f7-13a7-4805-98c9-1cef31ef58fb tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] 10.222.0.86 "GET /compute/v2.1/servers/88ed5c44-308f-42a6-86ca-9b4e58b3af9b" status: 200 len: 1503 microversion: 2.1 time: 0.171045 Jul 28 18:14:31.029639 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 155/304] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:30 2022] GET /compute/v2.1/servers/88ed5c44-308f-42a6-86ca-9b4e58b3af9b => generated 1503 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:31.193992 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3e91d50d-4ddc-4969-b6a7-19de74acda09 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:31.194691 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3e91d50d-4ddc-4969-b6a7-19de74acda09 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:31.202776 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3e91d50d-4ddc-4969-b6a7-19de74acda09 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:31.208377 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3e91d50d-4ddc-4969-b6a7-19de74acda09 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:31.209467 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3e91d50d-4ddc-4969-b6a7-19de74acda09 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:31.210012 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3e91d50d-4ddc-4969-b6a7-19de74acda09 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:31.277426 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-3e91d50d-4ddc-4969-b6a7-19de74acda09 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96e9a9e40c54b6a9a7f8560e4846be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef52881d75f407a942bf960230ea22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:31.287058 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-3e91d50d-4ddc-4969-b6a7-19de74acda09 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436" status: 200 len: 1345 microversion: 2.1 time: 0.097101 Jul 28 18:14:31.287630 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 150/305] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:31 2022] GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 => generated 1345 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:31.724791 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-36e98fe5-a9d5-4f3f-9614-be7117bb83e1 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:31.726697 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-36e98fe5-a9d5-4f3f-9614-be7117bb83e1 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:31.732420 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-36e98fe5-a9d5-4f3f-9614-be7117bb83e1 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:31.732879 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-36e98fe5-a9d5-4f3f-9614-be7117bb83e1 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:31.733678 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-36e98fe5-a9d5-4f3f-9614-be7117bb83e1 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:31.734125 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-36e98fe5-a9d5-4f3f-9614-be7117bb83e1 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:31.874043 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-36e98fe5-a9d5-4f3f-9614-be7117bb83e1 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:31.883157 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-36e98fe5-a9d5-4f3f-9614-be7117bb83e1 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1523 microversion: 2.1 time: 0.161542 Jul 28 18:14:31.883769 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 156/306] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:31 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:32.051669 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-031d108b-b2dd-4244-95e0-de555e1c0809 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:32.053008 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-031d108b-b2dd-4244-95e0-de555e1c0809 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] [instance: 88ed5c44-308f-42a6-86ca-9b4e58b3af9b] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:32.062795 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-031d108b-b2dd-4244-95e0-de555e1c0809 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:32.063463 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-031d108b-b2dd-4244-95e0-de555e1c0809 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:32.064654 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-031d108b-b2dd-4244-95e0-de555e1c0809 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:32.065414 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-031d108b-b2dd-4244-95e0-de555e1c0809 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:32.292627 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-031d108b-b2dd-4244-95e0-de555e1c0809 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a794c5d63c0f499db264113d64ae63b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d8da2c21474c958de9039caa0b547d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:32.305251 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-031d108b-b2dd-4244-95e0-de555e1c0809 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] 10.222.0.86 "GET /compute/v2.1/servers/88ed5c44-308f-42a6-86ca-9b4e58b3af9b" status: 200 len: 1503 microversion: 2.1 time: 0.257206 Jul 28 18:14:32.307027 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 151/307] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:32 2022] GET /compute/v2.1/servers/88ed5c44-308f-42a6-86ca-9b4e58b3af9b => generated 1503 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:32.311899 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-15ea4d7d-db40-47c5-a55b-7a9b3fa0ca1b tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:32.312654 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-15ea4d7d-db40-47c5-a55b-7a9b3fa0ca1b tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:32.326352 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-15ea4d7d-db40-47c5-a55b-7a9b3fa0ca1b tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:32.327038 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-15ea4d7d-db40-47c5-a55b-7a9b3fa0ca1b tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:32.328570 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-15ea4d7d-db40-47c5-a55b-7a9b3fa0ca1b tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:32.329217 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-15ea4d7d-db40-47c5-a55b-7a9b3fa0ca1b tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:32.365458 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-15ea4d7d-db40-47c5-a55b-7a9b3fa0ca1b tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:32.366123 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-15ea4d7d-db40-47c5-a55b-7a9b3fa0ca1b tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:32.366729 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.objects.instance [None req-15ea4d7d-db40-47c5-a55b-7a9b3fa0ca1b tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lazy-loading 'fault' on Instance uuid 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 {{(pid=118454) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:14:32.426298 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-15ea4d7d-db40-47c5-a55b-7a9b3fa0ca1b tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96e9a9e40c54b6a9a7f8560e4846be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef52881d75f407a942bf960230ea22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:32.434602 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-15ea4d7d-db40-47c5-a55b-7a9b3fa0ca1b tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436" status: 200 len: 1350 microversion: 2.1 time: 0.129211 Jul 28 18:14:32.435172 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 157/308] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:32 2022] GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 => generated 1350 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:32.701534 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-4df1fa17-1b63-4ebd-a339-c6d3da48caf2 req-fa73bfaf-e6b9-4f41-8662-fbf101b15d97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88ed5c44-308f-42a6-86ca-9b4e58b3af9b", "name": "network-vif-deleted", "tag": "9970c139-713a-4a09-a5db-ae9b44549c10"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:14:32.713137 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-4df1fa17-1b63-4ebd-a339-c6d3da48caf2 req-fa73bfaf-e6b9-4f41-8662-fbf101b15d97 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:32.713701 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-4df1fa17-1b63-4ebd-a339-c6d3da48caf2 req-fa73bfaf-e6b9-4f41-8662-fbf101b15d97 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:32.729643 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-4df1fa17-1b63-4ebd-a339-c6d3da48caf2 req-fa73bfaf-e6b9-4f41-8662-fbf101b15d97 service nova] Creating event network-vif-deleted:9970c139-713a-4a09-a5db-ae9b44549c10 for instance 88ed5c44-308f-42a6-86ca-9b4e58b3af9b on hv-cinder-84617 Jul 28 18:14:32.742070 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-4df1fa17-1b63-4ebd-a339-c6d3da48caf2 req-fa73bfaf-e6b9-4f41-8662-fbf101b15d97 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042656 Jul 28 18:14:32.743003 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 152/309] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:14:32.909956 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-4becb999-bd17-441f-9cfe-d0d2128e1fc5 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:32.909956 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-4becb999-bd17-441f-9cfe-d0d2128e1fc5 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:32.919351 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-4becb999-bd17-441f-9cfe-d0d2128e1fc5 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:32.919805 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-4becb999-bd17-441f-9cfe-d0d2128e1fc5 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:32.920577 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-4becb999-bd17-441f-9cfe-d0d2128e1fc5 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:32.921041 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-4becb999-bd17-441f-9cfe-d0d2128e1fc5 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:33.056355 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-4becb999-bd17-441f-9cfe-d0d2128e1fc5 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:33.063998 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-4becb999-bd17-441f-9cfe-d0d2128e1fc5 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1523 microversion: 2.1 time: 0.162361 Jul 28 18:14:33.064586 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 158/310] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:32 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:33.328401 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-84f820d7-9846-493f-ab90-a5d9f4444884 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:33.329134 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-84f820d7-9846-493f-ab90-a5d9f4444884 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] [instance: 88ed5c44-308f-42a6-86ca-9b4e58b3af9b] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:33.331067 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=72 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:14:33.336028 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-84f820d7-9846-493f-ab90-a5d9f4444884 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:33.336483 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-84f820d7-9846-493f-ab90-a5d9f4444884 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:33.337395 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-84f820d7-9846-493f-ab90-a5d9f4444884 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:33.337885 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-84f820d7-9846-493f-ab90-a5d9f4444884 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:33.368495 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-84f820d7-9846-493f-ab90-a5d9f4444884 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:33.368952 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-84f820d7-9846-493f-ab90-a5d9f4444884 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:33.370052 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.objects.instance [None req-84f820d7-9846-493f-ab90-a5d9f4444884 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lazy-loading 'fault' on Instance uuid 88ed5c44-308f-42a6-86ca-9b4e58b3af9b {{(pid=118453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:14:33.416612 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-84f820d7-9846-493f-ab90-a5d9f4444884 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a794c5d63c0f499db264113d64ae63b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d8da2c21474c958de9039caa0b547d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:33.422914 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-84f820d7-9846-493f-ab90-a5d9f4444884 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] 10.222.0.86 "GET /compute/v2.1/servers/88ed5c44-308f-42a6-86ca-9b4e58b3af9b" status: 200 len: 1304 microversion: 2.1 time: 0.098803 Jul 28 18:14:33.423596 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 153/311] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:33 2022] GET /compute/v2.1/servers/88ed5c44-308f-42a6-86ca-9b4e58b3af9b => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:33.461656 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-e61738a4-2c6c-46f4-a32d-f22e4ed5eefe tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:33.462428 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-e61738a4-2c6c-46f4-a32d-f22e4ed5eefe tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:33.469215 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e61738a4-2c6c-46f4-a32d-f22e4ed5eefe tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:33.469793 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e61738a4-2c6c-46f4-a32d-f22e4ed5eefe tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:33.470763 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e61738a4-2c6c-46f4-a32d-f22e4ed5eefe tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:33.471376 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e61738a4-2c6c-46f4-a32d-f22e4ed5eefe tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:33.485473 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.wsgi [None req-e61738a4-2c6c-46f4-a32d-f22e4ed5eefe tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] HTTP exception thrown: Instance 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 could not be found. Jul 28 18:14:33.490536 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-e61738a4-2c6c-46f4-a32d-f22e4ed5eefe tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Request method failure captured: Jul 28 18:14:33.490536 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: request: GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 HTTP/1.1 Jul 28 18:14:33.490536 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Accept: application/json Jul 28 18:14:33.490536 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Accept-Encoding: identity Jul 28 18:14:33.490536 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Connection: close Jul 28 18:14:33.490536 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Content-Length: 0 Jul 28 18:14:33.490536 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Content-Type: application/json Jul 28 18:14:33.490536 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Host: 10.222.0.86 Jul 28 18:14:33.490536 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Openstack-System-Scope: None Jul 28 18:14:33.490536 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: User-Agent: python-urllib3/1.26.10 Jul 28 18:14:33.490536 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Auth-Token: gAAAAABi4tGPNL5Lo0vwZssgEdqKlkDRrB5v7pjr9jA4A3DpPYn5rmtXkr65U2G4wojE9NTy-pGn43Ze6sbBHsRmH9BvLi1Tj-e9acw2vErL3_YD6oyKYpRrWgBwoZnisVBONnS_IsuSBj4-tJ1oiBTxSEVYJuWY2bcr_kVODWlmFEWNzKEFMXg Jul 28 18:14:33.490536 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Domain-Id: None Jul 28 18:14:33.490536 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Domain-Name: None Jul 28 18:14:33.490536 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Identity-Status: Confirmed Jul 28 18:14:33.490536 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Is-Admin-Project: True Jul 28 18:14:33.490536 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Domain-Id: default Jul 28 18:14:33.490536 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Domain-Name: Default Jul 28 18:14:33.490536 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Id: 8ef52881d75f407a942bf960230ea22e Jul 28 18:14:33.490536 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Name: tempest-DeleteServersTestJSON-949671387 Jul 28 18:14:33.490536 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Role: member,reader Jul 28 18:14:33.490536 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Roles: member,reader Jul 28 18:14:33.497496 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_8ef52881d75f407a942bf960230ea22e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/8ef52881d75f407a942bf960230ea22e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/8ef52881d75f407a942bf960230ea22e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/8ef52881d75f407a942bf960230ea22e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}] Jul 28 18:14:33.497496 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant: tempest-DeleteServersTestJSON-949671387 Jul 28 18:14:33.497496 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant-Id: 8ef52881d75f407a942bf960230ea22e Jul 28 18:14:33.497496 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant-Name: tempest-DeleteServersTestJSON-949671387 Jul 28 18:14:33.497496 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User: tempest-DeleteServersTestJSON-949671387-project Jul 28 18:14:33.497496 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Domain-Id: default Jul 28 18:14:33.497496 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Domain-Name: Default Jul 28 18:14:33.497496 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Id: d96e9a9e40c54b6a9a7f8560e4846be5 Jul 28 18:14:33.497496 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Name: tempest-DeleteServersTestJSON-949671387-project Jul 28 18:14:33.497496 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: method: > Jul 28 18:14:33.497496 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: exception: Instance 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 could not be found. Jul 28 18:14:33.497496 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: action_args: {'id': '6b81a4ab-5e71-4dd6-bed5-1a068b1ca436'} Jul 28 18:14:33.498875 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:14:33.498875 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:14:33.498875 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:14:33.498875 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:14:33.498875 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:14:33.498875 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:14:33.498875 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:14:33.498875 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:14:33.498875 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:14:33.498875 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:14:33.498875 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 could not be found. Jul 28 18:14:33.498875 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:14:33.498875 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:14:33.498875 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:14:33.498875 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:14:33.498875 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:14:33.498875 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:14:33.498875 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:14:33.498875 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:14:33.498875 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:14:33.501568 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:14:33.501568 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 18:14:33.501568 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 18:14:33.501568 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:14:33.501568 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:14:33.501568 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:14:33.501568 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:14:33.501568 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 could not be found. Jul 28 18:14:33.501568 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:14:33.501568 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:14:33.501568 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:14:33.501568 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:14:33.501568 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:14:33.501568 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:14:33.501568 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:14:33.501568 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:14:33.501568 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 could not be found. Jul 28 18:14:33.501568 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:14:33.504691 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-e61738a4-2c6c-46f4-a32d-f22e4ed5eefe tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Returning 404 to user: Instance 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 could not be found. {{(pid=118454) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:14:33.504691 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-e61738a4-2c6c-46f4-a32d-f22e4ed5eefe tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436" status: 404 len: 111 microversion: 2.1 time: 0.034069 Jul 28 18:14:33.504691 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 159/312] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:33 2022] GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:14:33.604810 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-219268ec-8530-4e31-be82-3e506b772615 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:33.606991 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-219268ec-8530-4e31-be82-3e506b772615 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:33.613773 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-219268ec-8530-4e31-be82-3e506b772615 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:33.614277 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-219268ec-8530-4e31-be82-3e506b772615 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:33.615372 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-219268ec-8530-4e31-be82-3e506b772615 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:33.615819 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-219268ec-8530-4e31-be82-3e506b772615 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:33.628449 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.wsgi [None req-219268ec-8530-4e31-be82-3e506b772615 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] HTTP exception thrown: Instance 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 could not be found. Jul 28 18:14:33.633322 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-219268ec-8530-4e31-be82-3e506b772615 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Request method failure captured: Jul 28 18:14:33.633322 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: request: GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436/os-volume_attachments HTTP/1.1 Jul 28 18:14:33.633322 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Accept: application/json Jul 28 18:14:33.633322 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Accept-Encoding: identity Jul 28 18:14:33.633322 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Connection: close Jul 28 18:14:33.633322 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Content-Length: 0 Jul 28 18:14:33.633322 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Content-Type: application/json Jul 28 18:14:33.633322 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Host: 10.222.0.86 Jul 28 18:14:33.633322 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Openstack-System-Scope: None Jul 28 18:14:33.633322 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: User-Agent: python-urllib3/1.26.10 Jul 28 18:14:33.633322 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Auth-Token: gAAAAABi4tGPNL5Lo0vwZssgEdqKlkDRrB5v7pjr9jA4A3DpPYn5rmtXkr65U2G4wojE9NTy-pGn43Ze6sbBHsRmH9BvLi1Tj-e9acw2vErL3_YD6oyKYpRrWgBwoZnisVBONnS_IsuSBj4-tJ1oiBTxSEVYJuWY2bcr_kVODWlmFEWNzKEFMXg Jul 28 18:14:33.633322 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Domain-Id: None Jul 28 18:14:33.633322 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Domain-Name: None Jul 28 18:14:33.633322 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Identity-Status: Confirmed Jul 28 18:14:33.633322 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Is-Admin-Project: True Jul 28 18:14:33.633322 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Id: default Jul 28 18:14:33.633322 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Name: Default Jul 28 18:14:33.633322 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Id: 8ef52881d75f407a942bf960230ea22e Jul 28 18:14:33.633322 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Name: tempest-DeleteServersTestJSON-949671387 Jul 28 18:14:33.633322 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Role: member,reader Jul 28 18:14:33.633322 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Roles: member,reader Jul 28 18:14:33.634747 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_8ef52881d75f407a942bf960230ea22e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/8ef52881d75f407a942bf960230ea22e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/8ef52881d75f407a942bf960230ea22e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/8ef52881d75f407a942bf960230ea22e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}] Jul 28 18:14:33.634747 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant: tempest-DeleteServersTestJSON-949671387 Jul 28 18:14:33.634747 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant-Id: 8ef52881d75f407a942bf960230ea22e Jul 28 18:14:33.634747 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant-Name: tempest-DeleteServersTestJSON-949671387 Jul 28 18:14:33.634747 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User: tempest-DeleteServersTestJSON-949671387-project Jul 28 18:14:33.634747 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Id: default Jul 28 18:14:33.634747 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Name: Default Jul 28 18:14:33.634747 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Id: d96e9a9e40c54b6a9a7f8560e4846be5 Jul 28 18:14:33.634747 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Name: tempest-DeleteServersTestJSON-949671387-project Jul 28 18:14:33.634747 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: method: > Jul 28 18:14:33.634747 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: exception: Instance 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 could not be found. Jul 28 18:14:33.634747 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: action_args: {'server_id': '6b81a4ab-5e71-4dd6-bed5-1a068b1ca436'} Jul 28 18:14:33.635778 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:14:33.635778 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:14:33.635778 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:14:33.635778 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:14:33.635778 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:14:33.635778 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:14:33.635778 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:14:33.635778 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:14:33.635778 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:14:33.635778 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:14:33.635778 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 could not be found. Jul 28 18:14:33.635778 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:14:33.635778 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:14:33.635778 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:14:33.635778 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:14:33.635778 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:14:33.635778 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:14:33.635778 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:14:33.635778 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:14:33.635778 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:14:33.637002 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:14:33.637002 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 18:14:33.637002 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 18:14:33.637002 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 18:14:33.637002 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 18:14:33.637002 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 28 18:14:33.637002 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 28 18:14:33.637002 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:14:33.637002 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:14:33.637002 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 could not be found. Jul 28 18:14:33.637002 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:14:33.637002 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:14:33.637002 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:14:33.637002 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:14:33.637002 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:14:33.637002 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:14:33.637002 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:14:33.637002 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:14:33.637002 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 could not be found. Jul 28 18:14:33.637002 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:14:33.639033 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-219268ec-8530-4e31-be82-3e506b772615 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Returning 404 to user: Instance 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 could not be found. {{(pid=118453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:14:33.639033 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-219268ec-8530-4e31-be82-3e506b772615 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034622 Jul 28 18:14:33.639033 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 154/313] 10.222.0.86 () {58 vars in 1302 bytes} [Thu Jul 28 18:14:33 2022] GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436/os-volume_attachments => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:14:34.086586 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-a3109efd-85aa-4f17-9de1-08597d4286e9 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:34.087219 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-a3109efd-85aa-4f17-9de1-08597d4286e9 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:34.094079 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a3109efd-85aa-4f17-9de1-08597d4286e9 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:34.094533 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a3109efd-85aa-4f17-9de1-08597d4286e9 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:34.095297 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a3109efd-85aa-4f17-9de1-08597d4286e9 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:34.095735 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a3109efd-85aa-4f17-9de1-08597d4286e9 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:34.230015 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-a3109efd-85aa-4f17-9de1-08597d4286e9 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:34.237844 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-a3109efd-85aa-4f17-9de1-08597d4286e9 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1523 microversion: 2.1 time: 0.155198 Jul 28 18:14:34.238443 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 160/314] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:34 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:34.445301 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5627fb58-3618-4bc0-b030-c19ece49eb00 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:34.445841 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-5627fb58-3618-4bc0-b030-c19ece49eb00 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] [instance: 88ed5c44-308f-42a6-86ca-9b4e58b3af9b] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:34.452006 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5627fb58-3618-4bc0-b030-c19ece49eb00 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:34.452471 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5627fb58-3618-4bc0-b030-c19ece49eb00 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:34.453250 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5627fb58-3618-4bc0-b030-c19ece49eb00 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:34.453791 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5627fb58-3618-4bc0-b030-c19ece49eb00 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:34.467961 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.wsgi [None req-5627fb58-3618-4bc0-b030-c19ece49eb00 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] HTTP exception thrown: Instance 88ed5c44-308f-42a6-86ca-9b4e58b3af9b could not be found. Jul 28 18:14:34.470275 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5627fb58-3618-4bc0-b030-c19ece49eb00 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Request method failure captured: Jul 28 18:14:34.470275 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: request: GET /compute/v2.1/servers/88ed5c44-308f-42a6-86ca-9b4e58b3af9b HTTP/1.1 Jul 28 18:14:34.470275 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Accept: application/json Jul 28 18:14:34.470275 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Accept-Encoding: identity Jul 28 18:14:34.470275 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Connection: close Jul 28 18:14:34.470275 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Content-Length: 0 Jul 28 18:14:34.470275 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Content-Type: application/json Jul 28 18:14:34.470275 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Host: 10.222.0.86 Jul 28 18:14:34.470275 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Openstack-System-Scope: None Jul 28 18:14:34.470275 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: User-Agent: python-urllib3/1.26.10 Jul 28 18:14:34.470275 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Auth-Token: gAAAAABi4tHjORw9_N_rIpk2JimFADcM1TzNcS4kaFninlKsd2LHVda4lxaTeFnWCmQoYpMIOwxeaYSkxihiNvweq3y5MUX2Kdcn0kzP_CtGum1p2ZxELi5EPM1BPOmA9KaegxHTTmvMUPfpUDYjpXBiQcQ6kLL4idWF80ZMZH8lLjLQNLLNyQc Jul 28 18:14:34.470275 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Domain-Id: None Jul 28 18:14:34.470275 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Domain-Name: None Jul 28 18:14:34.470275 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Identity-Status: Confirmed Jul 28 18:14:34.470275 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Is-Admin-Project: True Jul 28 18:14:34.470275 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Id: default Jul 28 18:14:34.470275 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Name: Default Jul 28 18:14:34.470275 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Id: 85d8da2c21474c958de9039caa0b547d Jul 28 18:14:34.470275 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Name: tempest-VolumesActionsTest-344111377 Jul 28 18:14:34.470275 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Role: member,reader Jul 28 18:14:34.470275 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Roles: member,reader Jul 28 18:14:34.471872 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_85d8da2c21474c958de9039caa0b547d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/85d8da2c21474c958de9039caa0b547d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/85d8da2c21474c958de9039caa0b547d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/85d8da2c21474c958de9039caa0b547d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}] Jul 28 18:14:34.471872 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant: tempest-VolumesActionsTest-344111377 Jul 28 18:14:34.471872 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant-Id: 85d8da2c21474c958de9039caa0b547d Jul 28 18:14:34.471872 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant-Name: tempest-VolumesActionsTest-344111377 Jul 28 18:14:34.471872 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User: tempest-VolumesActionsTest-344111377-project Jul 28 18:14:34.471872 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Id: default Jul 28 18:14:34.471872 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Name: Default Jul 28 18:14:34.471872 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Id: a794c5d63c0f499db264113d64ae63b5 Jul 28 18:14:34.471872 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Name: tempest-VolumesActionsTest-344111377-project Jul 28 18:14:34.471872 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: method: > Jul 28 18:14:34.471872 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: exception: Instance 88ed5c44-308f-42a6-86ca-9b4e58b3af9b could not be found. Jul 28 18:14:34.471872 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: action_args: {'id': '88ed5c44-308f-42a6-86ca-9b4e58b3af9b'} Jul 28 18:14:34.472703 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:14:34.472703 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:14:34.472703 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:14:34.472703 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:14:34.472703 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:14:34.472703 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:14:34.472703 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:14:34.472703 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:14:34.472703 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:14:34.472703 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:14:34.472703 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88ed5c44-308f-42a6-86ca-9b4e58b3af9b could not be found. Jul 28 18:14:34.472703 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:14:34.472703 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:14:34.472703 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:14:34.472703 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:14:34.472703 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:14:34.472703 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:14:34.472703 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:14:34.472703 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:14:34.472703 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:14:34.474072 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:14:34.474072 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 18:14:34.474072 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 18:14:34.474072 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:14:34.474072 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:14:34.474072 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:14:34.474072 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:14:34.474072 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88ed5c44-308f-42a6-86ca-9b4e58b3af9b could not be found. Jul 28 18:14:34.474072 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:14:34.474072 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:14:34.474072 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:14:34.474072 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:14:34.474072 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:14:34.474072 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:14:34.474072 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:14:34.474072 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:14:34.474072 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88ed5c44-308f-42a6-86ca-9b4e58b3af9b could not be found. Jul 28 18:14:34.474072 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:14:34.475353 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5627fb58-3618-4bc0-b030-c19ece49eb00 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Returning 404 to user: Instance 88ed5c44-308f-42a6-86ca-9b4e58b3af9b could not be found. {{(pid=118453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:14:34.475353 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-5627fb58-3618-4bc0-b030-c19ece49eb00 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] 10.222.0.86 "GET /compute/v2.1/servers/88ed5c44-308f-42a6-86ca-9b4e58b3af9b" status: 404 len: 111 microversion: 2.1 time: 0.031622 Jul 28 18:14:34.475353 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 155/315] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:34 2022] GET /compute/v2.1/servers/88ed5c44-308f-42a6-86ca-9b4e58b3af9b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:14:34.588686 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-98113cb2-c9b4-4793-bb0c-3faa0b9d7abd tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-66857324", "imageRef": "61912422-61cd-4ced-a573-85ee305e010f", "flavorRef": "452", "networks": [{"uuid": "23614efc-eed1-4326-a701-6c2e93f9f59c"}]}} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:14:34.649402 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.network.neutron [None req-98113cb2-c9b4-4793-bb0c-3faa0b9d7abd tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] validate_networks() for [('23614efc-eed1-4326-a701-6c2e93f9f59c', None, None, None, None, None)] {{(pid=118454) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 18:14:35.030029 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-c4a389e3-b280-4764-b519-03283520fc71 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:35.030527 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-c4a389e3-b280-4764-b519-03283520fc71 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:35.036629 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c4a389e3-b280-4764-b519-03283520fc71 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:35.037108 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c4a389e3-b280-4764-b519-03283520fc71 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:35.037886 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c4a389e3-b280-4764-b519-03283520fc71 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:35.038323 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c4a389e3-b280-4764-b519-03283520fc71 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:35.052281 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.wsgi [None req-c4a389e3-b280-4764-b519-03283520fc71 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] HTTP exception thrown: Instance 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 could not be found. Jul 28 18:14:35.059497 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-c4a389e3-b280-4764-b519-03283520fc71 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Request method failure captured: Jul 28 18:14:35.059497 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: request: DELETE /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 HTTP/1.1 Jul 28 18:14:35.059497 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Accept: application/json Jul 28 18:14:35.059497 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Accept-Encoding: identity Jul 28 18:14:35.059497 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Connection: close Jul 28 18:14:35.059497 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Content-Length: 0 Jul 28 18:14:35.059497 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Content-Type: application/json Jul 28 18:14:35.059497 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Host: 10.222.0.86 Jul 28 18:14:35.059497 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Openstack-System-Scope: None Jul 28 18:14:35.059497 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: User-Agent: python-urllib3/1.26.10 Jul 28 18:14:35.059497 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Auth-Token: gAAAAABi4tGPNL5Lo0vwZssgEdqKlkDRrB5v7pjr9jA4A3DpPYn5rmtXkr65U2G4wojE9NTy-pGn43Ze6sbBHsRmH9BvLi1Tj-e9acw2vErL3_YD6oyKYpRrWgBwoZnisVBONnS_IsuSBj4-tJ1oiBTxSEVYJuWY2bcr_kVODWlmFEWNzKEFMXg Jul 28 18:14:35.059497 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Domain-Id: None Jul 28 18:14:35.059497 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Domain-Name: None Jul 28 18:14:35.059497 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Identity-Status: Confirmed Jul 28 18:14:35.059497 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Is-Admin-Project: True Jul 28 18:14:35.059497 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Id: default Jul 28 18:14:35.059497 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Name: Default Jul 28 18:14:35.059497 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Id: 8ef52881d75f407a942bf960230ea22e Jul 28 18:14:35.059497 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Name: tempest-DeleteServersTestJSON-949671387 Jul 28 18:14:35.059497 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Role: member,reader Jul 28 18:14:35.059497 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Roles: member,reader Jul 28 18:14:35.060781 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_8ef52881d75f407a942bf960230ea22e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/8ef52881d75f407a942bf960230ea22e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/8ef52881d75f407a942bf960230ea22e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/8ef52881d75f407a942bf960230ea22e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}] Jul 28 18:14:35.060781 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant: tempest-DeleteServersTestJSON-949671387 Jul 28 18:14:35.060781 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant-Id: 8ef52881d75f407a942bf960230ea22e Jul 28 18:14:35.060781 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant-Name: tempest-DeleteServersTestJSON-949671387 Jul 28 18:14:35.060781 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User: tempest-DeleteServersTestJSON-949671387-project Jul 28 18:14:35.060781 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Id: default Jul 28 18:14:35.060781 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Name: Default Jul 28 18:14:35.060781 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Id: d96e9a9e40c54b6a9a7f8560e4846be5 Jul 28 18:14:35.060781 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Name: tempest-DeleteServersTestJSON-949671387-project Jul 28 18:14:35.060781 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: method: > Jul 28 18:14:35.060781 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: exception: Instance 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 could not be found. Jul 28 18:14:35.060781 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: action_args: {'id': '6b81a4ab-5e71-4dd6-bed5-1a068b1ca436'} Jul 28 18:14:35.061481 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:14:35.061481 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:14:35.061481 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:14:35.061481 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:14:35.061481 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:14:35.061481 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:14:35.061481 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:14:35.061481 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:14:35.061481 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:14:35.061481 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:14:35.061481 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 could not be found. Jul 28 18:14:35.061481 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:14:35.061481 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:14:35.061481 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:14:35.061481 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:14:35.061481 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:14:35.061481 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:14:35.061481 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:14:35.061481 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:14:35.061481 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:14:35.064525 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:14:35.064525 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 18:14:35.064525 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 18:14:35.064525 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 18:14:35.064525 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 18:14:35.064525 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:14:35.064525 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:14:35.064525 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:14:35.064525 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:14:35.064525 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 could not be found. Jul 28 18:14:35.064525 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:14:35.064525 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:14:35.064525 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:14:35.064525 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:14:35.064525 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:14:35.064525 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:14:35.064525 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:14:35.064525 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:14:35.064525 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 could not be found. Jul 28 18:14:35.064525 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:14:35.065685 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-c4a389e3-b280-4764-b519-03283520fc71 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Returning 404 to user: Instance 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 could not be found. {{(pid=118453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:14:35.065685 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-c4a389e3-b280-4764-b519-03283520fc71 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "DELETE /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436" status: 404 len: 111 microversion: 2.1 time: 0.035580 Jul 28 18:14:35.065685 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 156/316] 10.222.0.86 () {58 vars in 1239 bytes} [Thu Jul 28 18:14:35 2022] DELETE /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 18:14:35.071581 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d72ca256-efb1-4e76-96f9-58bec8eb50d3 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:35.073003 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-d72ca256-efb1-4e76-96f9-58bec8eb50d3 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] [instance: 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:35.079955 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d72ca256-efb1-4e76-96f9-58bec8eb50d3 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:35.080415 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d72ca256-efb1-4e76-96f9-58bec8eb50d3 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:35.081266 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d72ca256-efb1-4e76-96f9-58bec8eb50d3 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:35.081779 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d72ca256-efb1-4e76-96f9-58bec8eb50d3 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:35.097287 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.wsgi [None req-d72ca256-efb1-4e76-96f9-58bec8eb50d3 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] HTTP exception thrown: Instance 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 could not be found. Jul 28 18:14:35.099011 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d72ca256-efb1-4e76-96f9-58bec8eb50d3 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Request method failure captured: Jul 28 18:14:35.099011 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: request: GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 HTTP/1.1 Jul 28 18:14:35.099011 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Accept: application/json Jul 28 18:14:35.099011 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Accept-Encoding: identity Jul 28 18:14:35.099011 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Connection: close Jul 28 18:14:35.099011 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Content-Length: 0 Jul 28 18:14:35.099011 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Content-Type: application/json Jul 28 18:14:35.099011 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Host: 10.222.0.86 Jul 28 18:14:35.099011 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Openstack-System-Scope: None Jul 28 18:14:35.099011 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: User-Agent: python-urllib3/1.26.10 Jul 28 18:14:35.099011 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Auth-Token: gAAAAABi4tGPNL5Lo0vwZssgEdqKlkDRrB5v7pjr9jA4A3DpPYn5rmtXkr65U2G4wojE9NTy-pGn43Ze6sbBHsRmH9BvLi1Tj-e9acw2vErL3_YD6oyKYpRrWgBwoZnisVBONnS_IsuSBj4-tJ1oiBTxSEVYJuWY2bcr_kVODWlmFEWNzKEFMXg Jul 28 18:14:35.099011 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Domain-Id: None Jul 28 18:14:35.099011 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Domain-Name: None Jul 28 18:14:35.099011 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Identity-Status: Confirmed Jul 28 18:14:35.099011 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Is-Admin-Project: True Jul 28 18:14:35.099011 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Id: default Jul 28 18:14:35.099011 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Name: Default Jul 28 18:14:35.099011 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Id: 8ef52881d75f407a942bf960230ea22e Jul 28 18:14:35.099011 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Name: tempest-DeleteServersTestJSON-949671387 Jul 28 18:14:35.099011 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Role: member,reader Jul 28 18:14:35.099011 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Roles: member,reader Jul 28 18:14:35.100371 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_8ef52881d75f407a942bf960230ea22e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/8ef52881d75f407a942bf960230ea22e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/8ef52881d75f407a942bf960230ea22e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/8ef52881d75f407a942bf960230ea22e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}] Jul 28 18:14:35.100371 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant: tempest-DeleteServersTestJSON-949671387 Jul 28 18:14:35.100371 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant-Id: 8ef52881d75f407a942bf960230ea22e Jul 28 18:14:35.100371 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant-Name: tempest-DeleteServersTestJSON-949671387 Jul 28 18:14:35.100371 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User: tempest-DeleteServersTestJSON-949671387-project Jul 28 18:14:35.100371 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Id: default Jul 28 18:14:35.100371 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Name: Default Jul 28 18:14:35.100371 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Id: d96e9a9e40c54b6a9a7f8560e4846be5 Jul 28 18:14:35.100371 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Name: tempest-DeleteServersTestJSON-949671387-project Jul 28 18:14:35.100371 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: method: > Jul 28 18:14:35.100371 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: exception: Instance 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 could not be found. Jul 28 18:14:35.100371 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: action_args: {'id': '6b81a4ab-5e71-4dd6-bed5-1a068b1ca436'} Jul 28 18:14:35.101088 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:14:35.101088 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:14:35.101088 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:14:35.101088 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:14:35.101088 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:14:35.101088 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:14:35.101088 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:14:35.101088 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:14:35.101088 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:14:35.101088 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:14:35.101088 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 could not be found. Jul 28 18:14:35.101088 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:14:35.101088 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:14:35.101088 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:14:35.101088 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:14:35.101088 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:14:35.101088 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:14:35.101088 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:14:35.101088 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:14:35.101088 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:14:35.102158 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:14:35.102158 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 18:14:35.102158 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 18:14:35.102158 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:14:35.102158 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:14:35.102158 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:14:35.102158 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:14:35.102158 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 could not be found. Jul 28 18:14:35.102158 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:14:35.102158 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:14:35.102158 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:14:35.102158 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:14:35.102158 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:14:35.102158 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:14:35.102158 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:14:35.102158 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:14:35.102158 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 could not be found. Jul 28 18:14:35.102158 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:14:35.104229 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d72ca256-efb1-4e76-96f9-58bec8eb50d3 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] Returning 404 to user: Instance 6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 could not be found. {{(pid=118453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:14:35.104229 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-d72ca256-efb1-4e76-96f9-58bec8eb50d3 tempest-DeleteServersTestJSON-949671387 tempest-DeleteServersTestJSON-949671387-project] 10.222.0.86 "GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436" status: 404 len: 111 microversion: 2.1 time: 0.033335 Jul 28 18:14:35.104229 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 157/317] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:35 2022] GET /compute/v2.1/servers/6b81a4ab-5e71-4dd6-bed5-1a068b1ca436 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 18:14:35.131989 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.virt.hardware [None req-98113cb2-c9b4-4793-bb0c-3faa0b9d7abd tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Flavor limits 0:0:0 {{(pid=118454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 18:14:35.132507 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.virt.hardware [None req-98113cb2-c9b4-4793-bb0c-3faa0b9d7abd tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Image limits 0:0:0 {{(pid=118454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 18:14:35.133065 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.virt.hardware [None req-98113cb2-c9b4-4793-bb0c-3faa0b9d7abd tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Flavor pref 0:0:0 {{(pid=118454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 18:14:35.133554 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.virt.hardware [None req-98113cb2-c9b4-4793-bb0c-3faa0b9d7abd tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Image pref 0:0:0 {{(pid=118454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 18:14:35.134043 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.virt.hardware [None req-98113cb2-c9b4-4793-bb0c-3faa0b9d7abd tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 18:14:35.148776 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-98113cb2-c9b4-4793-bb0c-3faa0b9d7abd tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:35.149365 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-98113cb2-c9b4-4793-bb0c-3faa0b9d7abd tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:35.150297 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-98113cb2-c9b4-4793-bb0c-3faa0b9d7abd tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:35.150973 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-98113cb2-c9b4-4793-bb0c-3faa0b9d7abd tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:35.169662 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.quota [None req-98113cb2-c9b4-4793-bb0c-3faa0b9d7abd tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Getting quotas for project 85d8da2c21474c958de9039caa0b547d. Resources: {'cores', 'ram', 'instances'} {{(pid=118454) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 18:14:35.175008 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.quota [None req-98113cb2-c9b4-4793-bb0c-3faa0b9d7abd tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Getting quotas for user a794c5d63c0f499db264113d64ae63b5 and project 85d8da2c21474c958de9039caa0b547d. Resources: {'cores', 'ram', 'instances'} {{(pid=118454) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 18:14:35.188426 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-98113cb2-c9b4-4793-bb0c-3faa0b9d7abd tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Going to run 1 instances... {{(pid=118454) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 18:14:35.191028 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-98113cb2-c9b4-4793-bb0c-3faa0b9d7abd tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] [instance: 4de03ef3-ab21-41cf-ae15-3bfd95c3b509] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='61912422-61cd-4ced-a573-85ee305e010f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118454) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 18:14:35.262279 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-84da8dd9-d1ff-4bd6-bb02-f0f8474cc413 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:35.262889 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-84da8dd9-d1ff-4bd6-bb02-f0f8474cc413 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:35.273799 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-84da8dd9-d1ff-4bd6-bb02-f0f8474cc413 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:35.274704 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-84da8dd9-d1ff-4bd6-bb02-f0f8474cc413 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:35.275600 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-84da8dd9-d1ff-4bd6-bb02-f0f8474cc413 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:35.276112 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-84da8dd9-d1ff-4bd6-bb02-f0f8474cc413 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:35.374611 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-98113cb2-c9b4-4793-bb0c-3faa0b9d7abd tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.790507 Jul 28 18:14:35.375934 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 161/318] 10.222.0.86 () {60 vars in 1147 bytes} [Thu Jul 28 18:14:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 792 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 18:14:35.390175 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-0d5cc5b7-5581-4ed9-a7cb-4b26a818fbe8 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:35.395272 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-0d5cc5b7-5581-4ed9-a7cb-4b26a818fbe8 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] [instance: 4de03ef3-ab21-41cf-ae15-3bfd95c3b509] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:35.512776 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-0d5cc5b7-5581-4ed9-a7cb-4b26a818fbe8 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a794c5d63c0f499db264113d64ae63b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d8da2c21474c958de9039caa0b547d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:35.525665 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-0d5cc5b7-5581-4ed9-a7cb-4b26a818fbe8 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] 10.222.0.86 "GET /compute/v2.1/servers/4de03ef3-ab21-41cf-ae15-3bfd95c3b509" status: 200 len: 1212 microversion: 2.1 time: 0.143112 Jul 28 18:14:35.526372 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 162/319] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:35 2022] GET /compute/v2.1/servers/4de03ef3-ab21-41cf-ae15-3bfd95c3b509 => generated 1212 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:14:35.556352 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-84da8dd9-d1ff-4bd6-bb02-f0f8474cc413 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:35.566350 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-84da8dd9-d1ff-4bd6-bb02-f0f8474cc413 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1523 microversion: 2.1 time: 0.310061 Jul 28 18:14:35.567142 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 158/320] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:35 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1523 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:14:36.549489 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-ee9e0f8a-b303-472e-b8d6-bcfd8e6fb0db tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:36.549489 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-ee9e0f8a-b303-472e-b8d6-bcfd8e6fb0db tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] [instance: 4de03ef3-ab21-41cf-ae15-3bfd95c3b509] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:36.568074 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ee9e0f8a-b303-472e-b8d6-bcfd8e6fb0db tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:36.569618 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ee9e0f8a-b303-472e-b8d6-bcfd8e6fb0db tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:36.570602 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ee9e0f8a-b303-472e-b8d6-bcfd8e6fb0db tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:36.571997 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ee9e0f8a-b303-472e-b8d6-bcfd8e6fb0db tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:36.592899 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-79a42b40-2aa0-482d-bf9e-2c04593745aa tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:36.592899 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-79a42b40-2aa0-482d-bf9e-2c04593745aa tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:36.599737 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-79a42b40-2aa0-482d-bf9e-2c04593745aa tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:36.601107 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-79a42b40-2aa0-482d-bf9e-2c04593745aa tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:36.602131 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-79a42b40-2aa0-482d-bf9e-2c04593745aa tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:36.602733 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-79a42b40-2aa0-482d-bf9e-2c04593745aa tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:36.646866 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-ee9e0f8a-b303-472e-b8d6-bcfd8e6fb0db tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a794c5d63c0f499db264113d64ae63b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d8da2c21474c958de9039caa0b547d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:36.655322 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-ee9e0f8a-b303-472e-b8d6-bcfd8e6fb0db tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] 10.222.0.86 "GET /compute/v2.1/servers/4de03ef3-ab21-41cf-ae15-3bfd95c3b509" status: 200 len: 1216 microversion: 2.1 time: 0.112133 Jul 28 18:14:36.656526 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 163/321] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:36 2022] GET /compute/v2.1/servers/4de03ef3-ab21-41cf-ae15-3bfd95c3b509 => generated 1216 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:36.775538 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-79a42b40-2aa0-482d-bf9e-2c04593745aa tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:36.783227 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-79a42b40-2aa0-482d-bf9e-2c04593745aa tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1523 microversion: 2.1 time: 0.199038 Jul 28 18:14:36.783809 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 159/322] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:36 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1523 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:14:37.677140 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-3252644f-f8c2-4396-ad84-0b8dcd5e0edc tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:37.678872 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-3252644f-f8c2-4396-ad84-0b8dcd5e0edc tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] [instance: 4de03ef3-ab21-41cf-ae15-3bfd95c3b509] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:37.687846 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-3252644f-f8c2-4396-ad84-0b8dcd5e0edc tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:37.688530 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-3252644f-f8c2-4396-ad84-0b8dcd5e0edc tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:37.692111 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-3252644f-f8c2-4396-ad84-0b8dcd5e0edc tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:37.692111 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-3252644f-f8c2-4396-ad84-0b8dcd5e0edc tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:37.757021 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-3252644f-f8c2-4396-ad84-0b8dcd5e0edc tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a794c5d63c0f499db264113d64ae63b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d8da2c21474c958de9039caa0b547d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:37.766453 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-3252644f-f8c2-4396-ad84-0b8dcd5e0edc tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] 10.222.0.86 "GET /compute/v2.1/servers/4de03ef3-ab21-41cf-ae15-3bfd95c3b509" status: 200 len: 1264 microversion: 2.1 time: 0.093497 Jul 28 18:14:37.767175 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 164/323] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:37 2022] GET /compute/v2.1/servers/4de03ef3-ab21-41cf-ae15-3bfd95c3b509 => generated 1264 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:37.803845 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-4f19a598-516b-4509-a147-c3af1f73bc4f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:37.805137 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-4f19a598-516b-4509-a147-c3af1f73bc4f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:37.812567 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4f19a598-516b-4509-a147-c3af1f73bc4f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:37.813302 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4f19a598-516b-4509-a147-c3af1f73bc4f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:37.831653 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4f19a598-516b-4509-a147-c3af1f73bc4f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:37.831653 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4f19a598-516b-4509-a147-c3af1f73bc4f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:38.064987 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-4f19a598-516b-4509-a147-c3af1f73bc4f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:38.077967 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-4f19a598-516b-4509-a147-c3af1f73bc4f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1523 microversion: 2.1 time: 0.277916 Jul 28 18:14:38.079153 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 160/324] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:37 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1523 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:38.792517 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-35af32fb-2146-44e6-8607-6d97481f13e8 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:38.793751 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-35af32fb-2146-44e6-8607-6d97481f13e8 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] [instance: 4de03ef3-ab21-41cf-ae15-3bfd95c3b509] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:38.803376 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-35af32fb-2146-44e6-8607-6d97481f13e8 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:38.804044 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-35af32fb-2146-44e6-8607-6d97481f13e8 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:38.804910 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-35af32fb-2146-44e6-8607-6d97481f13e8 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:38.805496 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-35af32fb-2146-44e6-8607-6d97481f13e8 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:38.963914 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-35af32fb-2146-44e6-8607-6d97481f13e8 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a794c5d63c0f499db264113d64ae63b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d8da2c21474c958de9039caa0b547d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:38.986181 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-35af32fb-2146-44e6-8607-6d97481f13e8 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] 10.222.0.86 "GET /compute/v2.1/servers/4de03ef3-ab21-41cf-ae15-3bfd95c3b509" status: 200 len: 1312 microversion: 2.1 time: 0.190521 Jul 28 18:14:38.986181 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 165/325] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:38 2022] GET /compute/v2.1/servers/4de03ef3-ab21-41cf-ae15-3bfd95c3b509 => generated 1312 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:39.101346 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ee9a5a24-4ab2-43cc-848a-bca48dc7b9ac tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:39.102816 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ee9a5a24-4ab2-43cc-848a-bca48dc7b9ac tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:39.112273 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ee9a5a24-4ab2-43cc-848a-bca48dc7b9ac tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:39.114988 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ee9a5a24-4ab2-43cc-848a-bca48dc7b9ac tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:39.115799 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ee9a5a24-4ab2-43cc-848a-bca48dc7b9ac tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:39.116418 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ee9a5a24-4ab2-43cc-848a-bca48dc7b9ac tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:39.645572 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ee9a5a24-4ab2-43cc-848a-bca48dc7b9ac tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:39.674699 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ee9a5a24-4ab2-43cc-848a-bca48dc7b9ac tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1523 microversion: 2.1 time: 0.578690 Jul 28 18:14:39.687961 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 161/326] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:39 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1523 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:40.009013 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-673b40b1-4e8d-4c12-8a95-b53d9337671d tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:40.010191 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-673b40b1-4e8d-4c12-8a95-b53d9337671d tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] [instance: 4de03ef3-ab21-41cf-ae15-3bfd95c3b509] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:40.018967 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-673b40b1-4e8d-4c12-8a95-b53d9337671d tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:40.023022 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-673b40b1-4e8d-4c12-8a95-b53d9337671d tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:40.023863 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-673b40b1-4e8d-4c12-8a95-b53d9337671d tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:40.024313 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-673b40b1-4e8d-4c12-8a95-b53d9337671d tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:40.077605 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-b05593c5-e57d-4cb7-92db-daa48b8953fc req-b5ec0aed-06fe-4470-a23e-88067704b6c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4de03ef3-ab21-41cf-ae15-3bfd95c3b509", "tag": "ccceec3a-7f80-424c-bf00-64e3a0a8861c"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:14:40.102688 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-b05593c5-e57d-4cb7-92db-daa48b8953fc req-b5ec0aed-06fe-4470-a23e-88067704b6c8 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:40.103349 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-b05593c5-e57d-4cb7-92db-daa48b8953fc req-b5ec0aed-06fe-4470-a23e-88067704b6c8 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:40.125817 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-b05593c5-e57d-4cb7-92db-daa48b8953fc req-b5ec0aed-06fe-4470-a23e-88067704b6c8 service nova] Creating event network-changed:ccceec3a-7f80-424c-bf00-64e3a0a8861c for instance 4de03ef3-ab21-41cf-ae15-3bfd95c3b509 on hv-cinder-84617 Jul 28 18:14:40.132924 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-b05593c5-e57d-4cb7-92db-daa48b8953fc req-b5ec0aed-06fe-4470-a23e-88067704b6c8 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061647 Jul 28 18:14:40.134064 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 162/327] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:14:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 18:14:40.543809 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-673b40b1-4e8d-4c12-8a95-b53d9337671d tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a794c5d63c0f499db264113d64ae63b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d8da2c21474c958de9039caa0b547d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:40.553080 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-673b40b1-4e8d-4c12-8a95-b53d9337671d tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] 10.222.0.86 "GET /compute/v2.1/servers/4de03ef3-ab21-41cf-ae15-3bfd95c3b509" status: 200 len: 1312 microversion: 2.1 time: 0.551628 Jul 28 18:14:40.566506 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 166/328] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:40 2022] GET /compute/v2.1/servers/4de03ef3-ab21-41cf-ae15-3bfd95c3b509 => generated 1312 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:40.703194 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-1016db98-4ebe-4083-bc50-ae3ddcc00473 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:40.703915 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-1016db98-4ebe-4083-bc50-ae3ddcc00473 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:40.710995 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1016db98-4ebe-4083-bc50-ae3ddcc00473 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:40.711457 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1016db98-4ebe-4083-bc50-ae3ddcc00473 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:40.712311 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1016db98-4ebe-4083-bc50-ae3ddcc00473 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:40.713428 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1016db98-4ebe-4083-bc50-ae3ddcc00473 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:40.879677 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-1016db98-4ebe-4083-bc50-ae3ddcc00473 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:40.890094 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:14:40.897172 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-1016db98-4ebe-4083-bc50-ae3ddcc00473 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1523 microversion: 2.1 time: 0.204289 Jul 28 18:14:40.898270 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 163/329] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:40 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1523 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:41.579451 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-a9e0db60-66c2-41ce-815e-e9d1a156f684 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:41.580128 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-a9e0db60-66c2-41ce-815e-e9d1a156f684 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] [instance: 4de03ef3-ab21-41cf-ae15-3bfd95c3b509] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:41.587102 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a9e0db60-66c2-41ce-815e-e9d1a156f684 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:41.587624 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a9e0db60-66c2-41ce-815e-e9d1a156f684 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:41.588616 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a9e0db60-66c2-41ce-815e-e9d1a156f684 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:41.589341 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a9e0db60-66c2-41ce-815e-e9d1a156f684 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:41.738231 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-a9e0db60-66c2-41ce-815e-e9d1a156f684 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a794c5d63c0f499db264113d64ae63b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d8da2c21474c958de9039caa0b547d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:41.741786 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell1:SELECT=100 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:14:41.748865 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-a9e0db60-66c2-41ce-815e-e9d1a156f684 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] 10.222.0.86 "GET /compute/v2.1/servers/4de03ef3-ab21-41cf-ae15-3bfd95c3b509" status: 200 len: 1312 microversion: 2.1 time: 0.172050 Jul 28 18:14:41.748865 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 167/330] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:41 2022] GET /compute/v2.1/servers/4de03ef3-ab21-41cf-ae15-3bfd95c3b509 => generated 1312 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:41.919476 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-e1f17bd7-fb6a-4041-80f1-89b8ffd652af tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:41.920162 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-e1f17bd7-fb6a-4041-80f1-89b8ffd652af tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:41.933471 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e1f17bd7-fb6a-4041-80f1-89b8ffd652af tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:41.933997 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e1f17bd7-fb6a-4041-80f1-89b8ffd652af tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:41.934877 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e1f17bd7-fb6a-4041-80f1-89b8ffd652af tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:41.935522 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e1f17bd7-fb6a-4041-80f1-89b8ffd652af tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:42.117456 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-e1f17bd7-fb6a-4041-80f1-89b8ffd652af tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:42.127063 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-e1f17bd7-fb6a-4041-80f1-89b8ffd652af tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1523 microversion: 2.1 time: 0.210755 Jul 28 18:14:42.127063 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 164/331] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:41 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1523 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:42.768247 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-c0b395ba-76ef-4fcd-93c0-4f5ddfaf2965 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:42.768861 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-c0b395ba-76ef-4fcd-93c0-4f5ddfaf2965 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] [instance: 4de03ef3-ab21-41cf-ae15-3bfd95c3b509] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:42.776216 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c0b395ba-76ef-4fcd-93c0-4f5ddfaf2965 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:42.776671 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c0b395ba-76ef-4fcd-93c0-4f5ddfaf2965 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:42.777467 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c0b395ba-76ef-4fcd-93c0-4f5ddfaf2965 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:42.777912 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c0b395ba-76ef-4fcd-93c0-4f5ddfaf2965 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:42.918938 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-c0b395ba-76ef-4fcd-93c0-4f5ddfaf2965 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a794c5d63c0f499db264113d64ae63b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d8da2c21474c958de9039caa0b547d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:42.926685 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-c0b395ba-76ef-4fcd-93c0-4f5ddfaf2965 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] 10.222.0.86 "GET /compute/v2.1/servers/4de03ef3-ab21-41cf-ae15-3bfd95c3b509" status: 200 len: 1312 microversion: 2.1 time: 0.162855 Jul 28 18:14:42.927425 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 168/332] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:42 2022] GET /compute/v2.1/servers/4de03ef3-ab21-41cf-ae15-3bfd95c3b509 => generated 1312 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:43.147177 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-e5f4e56e-9bba-478e-ac56-736711e905ea tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:43.147912 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-e5f4e56e-9bba-478e-ac56-736711e905ea tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:43.154282 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e5f4e56e-9bba-478e-ac56-736711e905ea tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:43.159833 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e5f4e56e-9bba-478e-ac56-736711e905ea tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:43.159833 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e5f4e56e-9bba-478e-ac56-736711e905ea tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:43.159833 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e5f4e56e-9bba-478e-ac56-736711e905ea tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:43.300204 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-e5f4e56e-9bba-478e-ac56-736711e905ea tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:43.308313 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-e5f4e56e-9bba-478e-ac56-736711e905ea tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1523 microversion: 2.1 time: 0.165154 Jul 28 18:14:43.308956 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 165/333] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:43 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:43.948555 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-491be18b-d483-4cf1-ac84-3872e79ca85a tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:43.949326 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-491be18b-d483-4cf1-ac84-3872e79ca85a tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] [instance: 4de03ef3-ab21-41cf-ae15-3bfd95c3b509] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:43.956819 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-491be18b-d483-4cf1-ac84-3872e79ca85a tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:43.957132 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-491be18b-d483-4cf1-ac84-3872e79ca85a tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:43.957852 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-491be18b-d483-4cf1-ac84-3872e79ca85a tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:43.958290 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-491be18b-d483-4cf1-ac84-3872e79ca85a tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:44.111998 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-491be18b-d483-4cf1-ac84-3872e79ca85a tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a794c5d63c0f499db264113d64ae63b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d8da2c21474c958de9039caa0b547d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:44.120040 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-491be18b-d483-4cf1-ac84-3872e79ca85a tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] 10.222.0.86 "GET /compute/v2.1/servers/4de03ef3-ab21-41cf-ae15-3bfd95c3b509" status: 200 len: 1312 microversion: 2.1 time: 0.176245 Jul 28 18:14:44.120619 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 169/334] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:43 2022] GET /compute/v2.1/servers/4de03ef3-ab21-41cf-ae15-3bfd95c3b509 => generated 1312 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:44.331907 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b291b204-869f-4475-ba8c-b9140756c97e tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:44.332518 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b291b204-869f-4475-ba8c-b9140756c97e tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:44.338698 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b291b204-869f-4475-ba8c-b9140756c97e tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:44.339143 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b291b204-869f-4475-ba8c-b9140756c97e tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:44.339901 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b291b204-869f-4475-ba8c-b9140756c97e tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:44.340336 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b291b204-869f-4475-ba8c-b9140756c97e tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:44.475211 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b291b204-869f-4475-ba8c-b9140756c97e tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:44.483194 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b291b204-869f-4475-ba8c-b9140756c97e tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1523 microversion: 2.1 time: 0.155171 Jul 28 18:14:44.483756 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 166/335] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:44 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:14:45.141199 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-298c48d6-5a0c-4bfe-8fc3-c00f18c1d7e1 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:45.141811 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-298c48d6-5a0c-4bfe-8fc3-c00f18c1d7e1 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] [instance: 4de03ef3-ab21-41cf-ae15-3bfd95c3b509] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:45.148322 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-298c48d6-5a0c-4bfe-8fc3-c00f18c1d7e1 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:45.148775 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-298c48d6-5a0c-4bfe-8fc3-c00f18c1d7e1 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:45.149585 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-298c48d6-5a0c-4bfe-8fc3-c00f18c1d7e1 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:45.150019 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-298c48d6-5a0c-4bfe-8fc3-c00f18c1d7e1 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:45.167506 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell0:SELECT=2 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:14:45.282167 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-298c48d6-5a0c-4bfe-8fc3-c00f18c1d7e1 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a794c5d63c0f499db264113d64ae63b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d8da2c21474c958de9039caa0b547d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:45.289893 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-298c48d6-5a0c-4bfe-8fc3-c00f18c1d7e1 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] 10.222.0.86 "GET /compute/v2.1/servers/4de03ef3-ab21-41cf-ae15-3bfd95c3b509" status: 200 len: 1312 microversion: 2.1 time: 0.152521 Jul 28 18:14:45.290526 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 170/336] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:45 2022] GET /compute/v2.1/servers/4de03ef3-ab21-41cf-ae15-3bfd95c3b509 => generated 1312 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:45.503755 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-56d465d8-ef37-4af0-9607-8f85476c7eb0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:45.504672 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-56d465d8-ef37-4af0-9607-8f85476c7eb0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:45.511722 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-56d465d8-ef37-4af0-9607-8f85476c7eb0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:45.512570 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-56d465d8-ef37-4af0-9607-8f85476c7eb0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:45.513452 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-56d465d8-ef37-4af0-9607-8f85476c7eb0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:45.513895 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-56d465d8-ef37-4af0-9607-8f85476c7eb0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:45.654242 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-56d465d8-ef37-4af0-9607-8f85476c7eb0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:45.662280 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-56d465d8-ef37-4af0-9607-8f85476c7eb0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1523 microversion: 2.1 time: 0.162466 Jul 28 18:14:45.663086 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 167/337] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:45 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:46.034610 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [req-5974255f-57f0-41e1-8c37-07ba8d4c048d req-a9947e51-1ca1-4d5f-bb60-dfc711054c84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4de03ef3-ab21-41cf-ae15-3bfd95c3b509", "name": "network-vif-plugged", "status": "completed", "tag": "ccceec3a-7f80-424c-bf00-64e3a0a8861c"}]} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:14:46.039518 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell0:SELECT=8 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:14:46.047299 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-5974255f-57f0-41e1-8c37-07ba8d4c048d req-a9947e51-1ca1-4d5f-bb60-dfc711054c84 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:46.047759 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-5974255f-57f0-41e1-8c37-07ba8d4c048d req-a9947e51-1ca1-4d5f-bb60-dfc711054c84 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:46.064235 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.compute.server_external_events [req-5974255f-57f0-41e1-8c37-07ba8d4c048d req-a9947e51-1ca1-4d5f-bb60-dfc711054c84 service nova] Creating event network-vif-plugged:ccceec3a-7f80-424c-bf00-64e3a0a8861c for instance 4de03ef3-ab21-41cf-ae15-3bfd95c3b509 on hv-cinder-84617 Jul 28 18:14:46.074216 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [req-5974255f-57f0-41e1-8c37-07ba8d4c048d req-a9947e51-1ca1-4d5f-bb60-dfc711054c84 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042720 Jul 28 18:14:46.074216 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 171/338] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:14:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:14:46.312215 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d3c1276e-aa39-49b3-8e01-83816f670fd7 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:46.312668 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-d3c1276e-aa39-49b3-8e01-83816f670fd7 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] [instance: 4de03ef3-ab21-41cf-ae15-3bfd95c3b509] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:46.318770 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d3c1276e-aa39-49b3-8e01-83816f670fd7 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:46.319167 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d3c1276e-aa39-49b3-8e01-83816f670fd7 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:46.319975 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d3c1276e-aa39-49b3-8e01-83816f670fd7 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:46.320430 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d3c1276e-aa39-49b3-8e01-83816f670fd7 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:46.456936 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-d3c1276e-aa39-49b3-8e01-83816f670fd7 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a794c5d63c0f499db264113d64ae63b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d8da2c21474c958de9039caa0b547d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:46.464688 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-d3c1276e-aa39-49b3-8e01-83816f670fd7 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] 10.222.0.86 "GET /compute/v2.1/servers/4de03ef3-ab21-41cf-ae15-3bfd95c3b509" status: 200 len: 1312 microversion: 2.1 time: 0.156729 Jul 28 18:14:46.465406 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 168/339] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:46 2022] GET /compute/v2.1/servers/4de03ef3-ab21-41cf-ae15-3bfd95c3b509 => generated 1312 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:46.689972 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-f2f269de-7548-409d-9096-12b894151b41 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:46.695610 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-f2f269de-7548-409d-9096-12b894151b41 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:46.697586 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f2f269de-7548-409d-9096-12b894151b41 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:46.698046 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f2f269de-7548-409d-9096-12b894151b41 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:46.698815 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f2f269de-7548-409d-9096-12b894151b41 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:46.699267 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f2f269de-7548-409d-9096-12b894151b41 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:46.866390 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-f2f269de-7548-409d-9096-12b894151b41 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:46.874327 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-f2f269de-7548-409d-9096-12b894151b41 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1523 microversion: 2.1 time: 0.190405 Jul 28 18:14:46.874975 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 172/340] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:46 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1523 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:47.485992 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f7551bd0-119e-4bb8-8970-1829b8e4e789 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:47.486674 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f7551bd0-119e-4bb8-8970-1829b8e4e789 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] [instance: 4de03ef3-ab21-41cf-ae15-3bfd95c3b509] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:47.493270 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f7551bd0-119e-4bb8-8970-1829b8e4e789 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:47.493724 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f7551bd0-119e-4bb8-8970-1829b8e4e789 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:47.495190 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f7551bd0-119e-4bb8-8970-1829b8e4e789 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:47.495630 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f7551bd0-119e-4bb8-8970-1829b8e4e789 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:47.642154 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f7551bd0-119e-4bb8-8970-1829b8e4e789 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a794c5d63c0f499db264113d64ae63b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d8da2c21474c958de9039caa0b547d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:47.649577 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f7551bd0-119e-4bb8-8970-1829b8e4e789 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] 10.222.0.86 "GET /compute/v2.1/servers/4de03ef3-ab21-41cf-ae15-3bfd95c3b509" status: 200 len: 1312 microversion: 2.1 time: 0.167340 Jul 28 18:14:47.650185 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 169/341] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:47 2022] GET /compute/v2.1/servers/4de03ef3-ab21-41cf-ae15-3bfd95c3b509 => generated 1312 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:47.895310 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-18c08c38-7e25-4db7-8b0c-a72892c009ac tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:47.895966 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-18c08c38-7e25-4db7-8b0c-a72892c009ac tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:47.902577 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-18c08c38-7e25-4db7-8b0c-a72892c009ac tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:47.903202 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-18c08c38-7e25-4db7-8b0c-a72892c009ac tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:47.904060 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-18c08c38-7e25-4db7-8b0c-a72892c009ac tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:47.904540 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-18c08c38-7e25-4db7-8b0c-a72892c009ac tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:48.045693 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-18c08c38-7e25-4db7-8b0c-a72892c009ac tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:48.058708 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-18c08c38-7e25-4db7-8b0c-a72892c009ac tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1503 microversion: 2.1 time: 0.167638 Jul 28 18:14:48.059454 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 173/342] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:47 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1503 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:48.080810 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-06fb4deb-07a2-4982-ab74-8b2035b5956f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:48.081463 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-06fb4deb-07a2-4982-ab74-8b2035b5956f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:48.089098 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-06fb4deb-07a2-4982-ab74-8b2035b5956f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:48.089570 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-06fb4deb-07a2-4982-ab74-8b2035b5956f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:48.090844 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-06fb4deb-07a2-4982-ab74-8b2035b5956f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:48.091554 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-06fb4deb-07a2-4982-ab74-8b2035b5956f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:48.241163 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-06fb4deb-07a2-4982-ab74-8b2035b5956f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:48.250839 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-06fb4deb-07a2-4982-ab74-8b2035b5956f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1" status: 200 len: 1516 microversion: 2.1 time: 0.175026 Jul 28 18:14:48.251416 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 170/343] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:48 2022] GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 => generated 1516 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:14:48.679804 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-6e16d1c8-d136-4ed3-9243-2c51634ce69c tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:48.679804 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-6e16d1c8-d136-4ed3-9243-2c51634ce69c tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] [instance: 4de03ef3-ab21-41cf-ae15-3bfd95c3b509] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:48.692668 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-6e16d1c8-d136-4ed3-9243-2c51634ce69c tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:48.693477 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-6e16d1c8-d136-4ed3-9243-2c51634ce69c tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:48.694418 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-6e16d1c8-d136-4ed3-9243-2c51634ce69c tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:48.694955 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-6e16d1c8-d136-4ed3-9243-2c51634ce69c tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:48.842157 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-6e16d1c8-d136-4ed3-9243-2c51634ce69c tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a794c5d63c0f499db264113d64ae63b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d8da2c21474c958de9039caa0b547d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:48.850748 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-6e16d1c8-d136-4ed3-9243-2c51634ce69c tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] 10.222.0.86 "GET /compute/v2.1/servers/4de03ef3-ab21-41cf-ae15-3bfd95c3b509" status: 200 len: 1312 microversion: 2.1 time: 0.183048 Jul 28 18:14:48.851574 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 174/344] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:48 2022] GET /compute/v2.1/servers/4de03ef3-ab21-41cf-ae15-3bfd95c3b509 => generated 1312 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:49.871947 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f12cb164-b84d-43f2-827f-2288938d4e97 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:49.872949 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f12cb164-b84d-43f2-827f-2288938d4e97 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] [instance: 4de03ef3-ab21-41cf-ae15-3bfd95c3b509] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:49.879113 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f12cb164-b84d-43f2-827f-2288938d4e97 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:49.879567 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f12cb164-b84d-43f2-827f-2288938d4e97 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:49.880366 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f12cb164-b84d-43f2-827f-2288938d4e97 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:49.880809 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f12cb164-b84d-43f2-827f-2288938d4e97 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:50.066659 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f12cb164-b84d-43f2-827f-2288938d4e97 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a794c5d63c0f499db264113d64ae63b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d8da2c21474c958de9039caa0b547d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:50.074522 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f12cb164-b84d-43f2-827f-2288938d4e97 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] 10.222.0.86 "GET /compute/v2.1/servers/4de03ef3-ab21-41cf-ae15-3bfd95c3b509" status: 200 len: 1495 microversion: 2.1 time: 0.207177 Jul 28 18:14:50.075096 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 171/345] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:49 2022] GET /compute/v2.1/servers/4de03ef3-ab21-41cf-ae15-3bfd95c3b509 => generated 1495 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:51.116320 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-7ac3f32b-9de1-4dac-ad86-2ba370bd964a tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:14:51.118544 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-7ac3f32b-9de1-4dac-ad86-2ba370bd964a tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:51.125517 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-7ac3f32b-9de1-4dac-ad86-2ba370bd964a tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:51.126058 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-7ac3f32b-9de1-4dac-ad86-2ba370bd964a tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:51.126904 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-7ac3f32b-9de1-4dac-ad86-2ba370bd964a tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:51.127421 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-7ac3f32b-9de1-4dac-ad86-2ba370bd964a tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:51.166217 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.objects.instance [None req-7ac3f32b-9de1-4dac-ad86-2ba370bd964a tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lazy-loading 'flavor' on Instance uuid 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 {{(pid=118454) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:14:51.212173 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-96d0a8e8-5b3b-4b82-b56d-c223e74c3a65 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:51.213958 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-96d0a8e8-5b3b-4b82-b56d-c223e74c3a65 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] [instance: 4de03ef3-ab21-41cf-ae15-3bfd95c3b509] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:51.219633 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-96d0a8e8-5b3b-4b82-b56d-c223e74c3a65 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:51.220078 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-96d0a8e8-5b3b-4b82-b56d-c223e74c3a65 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:51.221028 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-96d0a8e8-5b3b-4b82-b56d-c223e74c3a65 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:51.221470 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-96d0a8e8-5b3b-4b82-b56d-c223e74c3a65 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:51.247766 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-96d0a8e8-5b3b-4b82-b56d-c223e74c3a65 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] [instance: 4de03ef3-ab21-41cf-ae15-3bfd95c3b509] Going to try to terminate instance {{(pid=118453) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 18:14:51.493491 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-7ac3f32b-9de1-4dac-ad86-2ba370bd964a tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "POST /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1/action" status: 200 len: 32 microversion: 2.1 time: 0.381364 Jul 28 18:14:51.494280 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 175/346] 10.222.0.86 () {60 vars in 1278 bytes} [Thu Jul 28 18:14:51 2022] POST /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1/action => generated 32 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 18:14:51.511881 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-08247cf1-ae68-4b96-84e1-d501364783ee tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:51.512586 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-08247cf1-ae68-4b96-84e1-d501364783ee tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:51.521859 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-08247cf1-ae68-4b96-84e1-d501364783ee tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:51.522314 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-08247cf1-ae68-4b96-84e1-d501364783ee tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:51.523081 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-08247cf1-ae68-4b96-84e1-d501364783ee tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:51.523519 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-08247cf1-ae68-4b96-84e1-d501364783ee tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:51.584313 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-96d0a8e8-5b3b-4b82-b56d-c223e74c3a65 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] 10.222.0.86 "DELETE /compute/v2.1/servers/4de03ef3-ab21-41cf-ae15-3bfd95c3b509" status: 204 len: 0 microversion: 2.1 time: 0.373510 Jul 28 18:14:51.584313 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 172/347] 10.222.0.86 () {58 vars in 1239 bytes} [Thu Jul 28 18:14:51 2022] DELETE /compute/v2.1/servers/4de03ef3-ab21-41cf-ae15-3bfd95c3b509 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 18:14:51.590889 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0c819fcd-48ba-40b9-9d15-74b893c053d5 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:51.591841 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0c819fcd-48ba-40b9-9d15-74b893c053d5 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] [instance: 4de03ef3-ab21-41cf-ae15-3bfd95c3b509] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:51.598007 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0c819fcd-48ba-40b9-9d15-74b893c053d5 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:51.598462 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0c819fcd-48ba-40b9-9d15-74b893c053d5 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:51.599233 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0c819fcd-48ba-40b9-9d15-74b893c053d5 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:51.599678 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0c819fcd-48ba-40b9-9d15-74b893c053d5 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:51.696881 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-08247cf1-ae68-4b96-84e1-d501364783ee tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:51.706144 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-08247cf1-ae68-4b96-84e1-d501364783ee tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1" status: 200 len: 1522 microversion: 2.1 time: 0.203799 Jul 28 18:14:51.710723 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 176/348] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:51 2022] GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:51.762471 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-0c819fcd-48ba-40b9-9d15-74b893c053d5 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a794c5d63c0f499db264113d64ae63b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d8da2c21474c958de9039caa0b547d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:51.770313 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0c819fcd-48ba-40b9-9d15-74b893c053d5 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] 10.222.0.86 "GET /compute/v2.1/servers/4de03ef3-ab21-41cf-ae15-3bfd95c3b509" status: 200 len: 1501 microversion: 2.1 time: 0.183316 Jul 28 18:14:51.774942 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 173/349] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:51 2022] GET /compute/v2.1/servers/4de03ef3-ab21-41cf-ae15-3bfd95c3b509 => generated 1501 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:14:52.730117 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-7967ce8e-3192-4d8c-a280-d6c65b921fc6 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:52.730928 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-7967ce8e-3192-4d8c-a280-d6c65b921fc6 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:52.737777 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-7967ce8e-3192-4d8c-a280-d6c65b921fc6 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:52.738305 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-7967ce8e-3192-4d8c-a280-d6c65b921fc6 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:52.739178 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-7967ce8e-3192-4d8c-a280-d6c65b921fc6 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:52.739711 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-7967ce8e-3192-4d8c-a280-d6c65b921fc6 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:52.791603 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-9c4fd355-11cc-4408-92e8-6a1d69f8783f tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:52.792339 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-9c4fd355-11cc-4408-92e8-6a1d69f8783f tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] [instance: 4de03ef3-ab21-41cf-ae15-3bfd95c3b509] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:52.810776 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9c4fd355-11cc-4408-92e8-6a1d69f8783f tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:52.815513 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9c4fd355-11cc-4408-92e8-6a1d69f8783f tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:52.815513 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9c4fd355-11cc-4408-92e8-6a1d69f8783f tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:52.815513 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9c4fd355-11cc-4408-92e8-6a1d69f8783f tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:52.922829 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-7967ce8e-3192-4d8c-a280-d6c65b921fc6 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:52.930591 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-7967ce8e-3192-4d8c-a280-d6c65b921fc6 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1" status: 200 len: 1522 microversion: 2.1 time: 0.204609 Jul 28 18:14:52.931169 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 177/350] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:52 2022] GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:52.970293 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-9c4fd355-11cc-4408-92e8-6a1d69f8783f tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a794c5d63c0f499db264113d64ae63b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d8da2c21474c958de9039caa0b547d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:52.977971 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-9c4fd355-11cc-4408-92e8-6a1d69f8783f tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] 10.222.0.86 "GET /compute/v2.1/servers/4de03ef3-ab21-41cf-ae15-3bfd95c3b509" status: 200 len: 1501 microversion: 2.1 time: 0.190531 Jul 28 18:14:52.978548 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 174/351] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:52 2022] GET /compute/v2.1/servers/4de03ef3-ab21-41cf-ae15-3bfd95c3b509 => generated 1501 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:14:53.952723 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-93599bb1-ad23-4a2f-a4ac-84b14934de8c tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:53.953388 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-93599bb1-ad23-4a2f-a4ac-84b14934de8c tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:53.959914 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-93599bb1-ad23-4a2f-a4ac-84b14934de8c tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:53.960392 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-93599bb1-ad23-4a2f-a4ac-84b14934de8c tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:53.961203 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-93599bb1-ad23-4a2f-a4ac-84b14934de8c tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:53.961642 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-93599bb1-ad23-4a2f-a4ac-84b14934de8c tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:54.001512 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a156160e-ffa7-4e2e-86d5-6fdea429308f tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:54.002743 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-a156160e-ffa7-4e2e-86d5-6fdea429308f tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] [instance: 4de03ef3-ab21-41cf-ae15-3bfd95c3b509] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:54.009072 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a156160e-ffa7-4e2e-86d5-6fdea429308f tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:54.009522 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a156160e-ffa7-4e2e-86d5-6fdea429308f tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:54.010458 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a156160e-ffa7-4e2e-86d5-6fdea429308f tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:54.011683 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a156160e-ffa7-4e2e-86d5-6fdea429308f tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:54.184305 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-93599bb1-ad23-4a2f-a4ac-84b14934de8c tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:54.193020 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-93599bb1-ad23-4a2f-a4ac-84b14934de8c tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1" status: 200 len: 1522 microversion: 2.1 time: 0.244984 Jul 28 18:14:54.193885 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 178/352] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:53 2022] GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:54.261304 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-a156160e-ffa7-4e2e-86d5-6fdea429308f tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a794c5d63c0f499db264113d64ae63b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d8da2c21474c958de9039caa0b547d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:54.269491 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-a156160e-ffa7-4e2e-86d5-6fdea429308f tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] 10.222.0.86 "GET /compute/v2.1/servers/4de03ef3-ab21-41cf-ae15-3bfd95c3b509" status: 200 len: 1501 microversion: 2.1 time: 0.271829 Jul 28 18:14:54.270162 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 175/353] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:53 2022] GET /compute/v2.1/servers/4de03ef3-ab21-41cf-ae15-3bfd95c3b509 => generated 1501 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:54.304636 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [req-77bc2e6e-9d6c-4a5d-8113-280742fefa52 req-e3380e4b-6c77-42c6-a173-c4bfc9a36064 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4de03ef3-ab21-41cf-ae15-3bfd95c3b509", "name": "network-vif-deleted", "tag": "ccceec3a-7f80-424c-bf00-64e3a0a8861c"}]} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:14:54.315117 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-77bc2e6e-9d6c-4a5d-8113-280742fefa52 req-e3380e4b-6c77-42c6-a173-c4bfc9a36064 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:54.315586 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-77bc2e6e-9d6c-4a5d-8113-280742fefa52 req-e3380e4b-6c77-42c6-a173-c4bfc9a36064 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:54.327937 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.compute.server_external_events [req-77bc2e6e-9d6c-4a5d-8113-280742fefa52 req-e3380e4b-6c77-42c6-a173-c4bfc9a36064 service nova] Creating event network-vif-deleted:ccceec3a-7f80-424c-bf00-64e3a0a8861c for instance 4de03ef3-ab21-41cf-ae15-3bfd95c3b509 on hv-cinder-84617 Jul 28 18:14:54.332982 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [req-77bc2e6e-9d6c-4a5d-8113-280742fefa52 req-e3380e4b-6c77-42c6-a173-c4bfc9a36064 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032117 Jul 28 18:14:54.333889 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 179/354] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:14:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:14:55.217848 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-bb597ccc-61bf-4497-a5a1-a69e824d599a tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:55.219220 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-bb597ccc-61bf-4497-a5a1-a69e824d599a tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:55.227170 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bb597ccc-61bf-4497-a5a1-a69e824d599a tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:55.228752 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bb597ccc-61bf-4497-a5a1-a69e824d599a tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:55.230201 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bb597ccc-61bf-4497-a5a1-a69e824d599a tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:55.230796 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bb597ccc-61bf-4497-a5a1-a69e824d599a tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:55.293054 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-1e510df6-8c09-4f80-b07a-cfdb1c15ec46 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:55.297184 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-1e510df6-8c09-4f80-b07a-cfdb1c15ec46 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] [instance: 4de03ef3-ab21-41cf-ae15-3bfd95c3b509] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:55.306850 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-1e510df6-8c09-4f80-b07a-cfdb1c15ec46 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:55.307404 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-1e510df6-8c09-4f80-b07a-cfdb1c15ec46 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:55.308183 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-1e510df6-8c09-4f80-b07a-cfdb1c15ec46 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:55.308599 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-1e510df6-8c09-4f80-b07a-cfdb1c15ec46 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:55.361409 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-1e510df6-8c09-4f80-b07a-cfdb1c15ec46 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:55.361409 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-1e510df6-8c09-4f80-b07a-cfdb1c15ec46 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:55.361409 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.objects.instance [None req-1e510df6-8c09-4f80-b07a-cfdb1c15ec46 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lazy-loading 'fault' on Instance uuid 4de03ef3-ab21-41cf-ae15-3bfd95c3b509 {{(pid=118454) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:14:55.421460 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-bb597ccc-61bf-4497-a5a1-a69e824d599a tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:55.432222 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-bb597ccc-61bf-4497-a5a1-a69e824d599a tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1" status: 200 len: 1522 microversion: 2.1 time: 0.219554 Jul 28 18:14:55.433617 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 176/355] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:55 2022] GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:55.437154 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-1e510df6-8c09-4f80-b07a-cfdb1c15ec46 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a794c5d63c0f499db264113d64ae63b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d8da2c21474c958de9039caa0b547d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:55.447322 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-1e510df6-8c09-4f80-b07a-cfdb1c15ec46 tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] 10.222.0.86 "GET /compute/v2.1/servers/4de03ef3-ab21-41cf-ae15-3bfd95c3b509" status: 200 len: 1302 microversion: 2.1 time: 0.159541 Jul 28 18:14:55.452694 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 180/356] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:55 2022] GET /compute/v2.1/servers/4de03ef3-ab21-41cf-ae15-3bfd95c3b509 => generated 1302 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:14:56.456330 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-1cf83700-d31a-4519-a69d-b6c4a37be78b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:56.456994 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-1cf83700-d31a-4519-a69d-b6c4a37be78b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:56.463287 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1cf83700-d31a-4519-a69d-b6c4a37be78b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:56.463737 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1cf83700-d31a-4519-a69d-b6c4a37be78b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:56.465125 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1cf83700-d31a-4519-a69d-b6c4a37be78b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:56.465574 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1cf83700-d31a-4519-a69d-b6c4a37be78b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:56.477085 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-4d1f7939-df9d-43e2-a029-ffd3832cf02a tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:56.478296 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-4d1f7939-df9d-43e2-a029-ffd3832cf02a tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] [instance: 4de03ef3-ab21-41cf-ae15-3bfd95c3b509] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:56.485722 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-4d1f7939-df9d-43e2-a029-ffd3832cf02a tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:56.486222 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-4d1f7939-df9d-43e2-a029-ffd3832cf02a tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:56.487142 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-4d1f7939-df9d-43e2-a029-ffd3832cf02a tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:56.487592 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-4d1f7939-df9d-43e2-a029-ffd3832cf02a tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:56.501473 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.wsgi [None req-4d1f7939-df9d-43e2-a029-ffd3832cf02a tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] HTTP exception thrown: Instance 4de03ef3-ab21-41cf-ae15-3bfd95c3b509 could not be found. Jul 28 18:14:56.503137 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-4d1f7939-df9d-43e2-a029-ffd3832cf02a tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Request method failure captured: Jul 28 18:14:56.503137 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: request: GET /compute/v2.1/servers/4de03ef3-ab21-41cf-ae15-3bfd95c3b509 HTTP/1.1 Jul 28 18:14:56.503137 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Accept: application/json Jul 28 18:14:56.503137 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Accept-Encoding: identity Jul 28 18:14:56.503137 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Connection: close Jul 28 18:14:56.503137 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Content-Length: 0 Jul 28 18:14:56.503137 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Content-Type: application/json Jul 28 18:14:56.503137 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Host: 10.222.0.86 Jul 28 18:14:56.503137 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Openstack-System-Scope: None Jul 28 18:14:56.503137 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: User-Agent: python-urllib3/1.26.10 Jul 28 18:14:56.503137 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Auth-Token: gAAAAABi4tHjORw9_N_rIpk2JimFADcM1TzNcS4kaFninlKsd2LHVda4lxaTeFnWCmQoYpMIOwxeaYSkxihiNvweq3y5MUX2Kdcn0kzP_CtGum1p2ZxELi5EPM1BPOmA9KaegxHTTmvMUPfpUDYjpXBiQcQ6kLL4idWF80ZMZH8lLjLQNLLNyQc Jul 28 18:14:56.503137 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Domain-Id: None Jul 28 18:14:56.503137 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Domain-Name: None Jul 28 18:14:56.503137 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Identity-Status: Confirmed Jul 28 18:14:56.503137 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Is-Admin-Project: True Jul 28 18:14:56.503137 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Domain-Id: default Jul 28 18:14:56.503137 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Domain-Name: Default Jul 28 18:14:56.503137 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Id: 85d8da2c21474c958de9039caa0b547d Jul 28 18:14:56.503137 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Name: tempest-VolumesActionsTest-344111377 Jul 28 18:14:56.503137 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Role: member,reader Jul 28 18:14:56.503137 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Roles: member,reader Jul 28 18:14:56.504616 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_85d8da2c21474c958de9039caa0b547d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/85d8da2c21474c958de9039caa0b547d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/85d8da2c21474c958de9039caa0b547d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/85d8da2c21474c958de9039caa0b547d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}] Jul 28 18:14:56.504616 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant: tempest-VolumesActionsTest-344111377 Jul 28 18:14:56.504616 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant-Id: 85d8da2c21474c958de9039caa0b547d Jul 28 18:14:56.504616 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant-Name: tempest-VolumesActionsTest-344111377 Jul 28 18:14:56.504616 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User: tempest-VolumesActionsTest-344111377-project Jul 28 18:14:56.504616 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Domain-Id: default Jul 28 18:14:56.504616 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Domain-Name: Default Jul 28 18:14:56.504616 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Id: a794c5d63c0f499db264113d64ae63b5 Jul 28 18:14:56.504616 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Name: tempest-VolumesActionsTest-344111377-project Jul 28 18:14:56.504616 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: method: > Jul 28 18:14:56.504616 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: exception: Instance 4de03ef3-ab21-41cf-ae15-3bfd95c3b509 could not be found. Jul 28 18:14:56.504616 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: action_args: {'id': '4de03ef3-ab21-41cf-ae15-3bfd95c3b509'} Jul 28 18:14:56.505578 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:14:56.505578 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:14:56.505578 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:14:56.505578 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:14:56.505578 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:14:56.505578 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:14:56.505578 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:14:56.505578 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:14:56.505578 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:14:56.505578 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:14:56.505578 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4de03ef3-ab21-41cf-ae15-3bfd95c3b509 could not be found. Jul 28 18:14:56.505578 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:14:56.505578 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:14:56.505578 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:14:56.505578 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:14:56.505578 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:14:56.505578 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:14:56.505578 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:14:56.505578 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:14:56.505578 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:14:56.506876 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:14:56.506876 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 18:14:56.506876 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 18:14:56.506876 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:14:56.506876 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:14:56.506876 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:14:56.506876 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:14:56.506876 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4de03ef3-ab21-41cf-ae15-3bfd95c3b509 could not be found. Jul 28 18:14:56.506876 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:14:56.506876 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:14:56.506876 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:14:56.506876 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:14:56.506876 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:14:56.506876 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:14:56.506876 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:14:56.506876 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:14:56.506876 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4de03ef3-ab21-41cf-ae15-3bfd95c3b509 could not be found. Jul 28 18:14:56.506876 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:14:56.507902 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-4d1f7939-df9d-43e2-a029-ffd3832cf02a tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] Returning 404 to user: Instance 4de03ef3-ab21-41cf-ae15-3bfd95c3b509 could not be found. {{(pid=118454) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:14:56.507902 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-4d1f7939-df9d-43e2-a029-ffd3832cf02a tempest-VolumesActionsTest-344111377 tempest-VolumesActionsTest-344111377-project] 10.222.0.86 "GET /compute/v2.1/servers/4de03ef3-ab21-41cf-ae15-3bfd95c3b509" status: 404 len: 111 microversion: 2.1 time: 0.031726 Jul 28 18:14:56.507902 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 181/357] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:56 2022] GET /compute/v2.1/servers/4de03ef3-ab21-41cf-ae15-3bfd95c3b509 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 18:14:56.608923 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-1cf83700-d31a-4519-a69d-b6c4a37be78b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:56.617581 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-1cf83700-d31a-4519-a69d-b6c4a37be78b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1" status: 200 len: 1522 microversion: 2.1 time: 0.164999 Jul 28 18:14:56.619579 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 177/358] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:56 2022] GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:57.646282 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-95a984fc-c93b-4936-b43c-21dc71fbbca6 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:57.646940 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-95a984fc-c93b-4936-b43c-21dc71fbbca6 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:57.654876 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-95a984fc-c93b-4936-b43c-21dc71fbbca6 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:57.655418 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-95a984fc-c93b-4936-b43c-21dc71fbbca6 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:57.656300 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-95a984fc-c93b-4936-b43c-21dc71fbbca6 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:57.656741 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-95a984fc-c93b-4936-b43c-21dc71fbbca6 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:57.793599 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-95a984fc-c93b-4936-b43c-21dc71fbbca6 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:57.801283 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-95a984fc-c93b-4936-b43c-21dc71fbbca6 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1" status: 200 len: 1522 microversion: 2.1 time: 0.160043 Jul 28 18:14:57.801838 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 182/359] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:57 2022] GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:58.822131 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ab74d8e7-5943-40c1-b862-52976fa8d4a3 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:58.822736 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ab74d8e7-5943-40c1-b862-52976fa8d4a3 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:58.829003 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ab74d8e7-5943-40c1-b862-52976fa8d4a3 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:58.829453 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ab74d8e7-5943-40c1-b862-52976fa8d4a3 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:58.830202 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ab74d8e7-5943-40c1-b862-52976fa8d4a3 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:58.830635 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ab74d8e7-5943-40c1-b862-52976fa8d4a3 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:59.048334 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ab74d8e7-5943-40c1-b862-52976fa8d4a3 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:59.050690 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:14:59.056793 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ab74d8e7-5943-40c1-b862-52976fa8d4a3 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1" status: 200 len: 1522 microversion: 2.1 time: 0.238589 Jul 28 18:14:59.057587 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 178/360] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:58 2022] GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:15:00.077518 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-aadacc0b-8ea3-4ad1-a932-7d95600208f0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:15:00.078135 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-aadacc0b-8ea3-4ad1-a932-7d95600208f0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:15:00.084568 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-aadacc0b-8ea3-4ad1-a932-7d95600208f0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:00.085055 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-aadacc0b-8ea3-4ad1-a932-7d95600208f0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:00.085853 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-aadacc0b-8ea3-4ad1-a932-7d95600208f0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:00.086331 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-aadacc0b-8ea3-4ad1-a932-7d95600208f0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:00.218872 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-aadacc0b-8ea3-4ad1-a932-7d95600208f0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:15:00.226343 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-aadacc0b-8ea3-4ad1-a932-7d95600208f0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1" status: 200 len: 1522 microversion: 2.1 time: 0.152824 Jul 28 18:15:00.226902 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 183/361] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:15:00 2022] GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:15:01.256015 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-09044f4c-9546-4151-82ea-8aeb6e888e6c tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:15:01.256665 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-09044f4c-9546-4151-82ea-8aeb6e888e6c tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:15:01.263732 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-09044f4c-9546-4151-82ea-8aeb6e888e6c tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:01.264187 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-09044f4c-9546-4151-82ea-8aeb6e888e6c tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:01.265010 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-09044f4c-9546-4151-82ea-8aeb6e888e6c tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:01.265479 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-09044f4c-9546-4151-82ea-8aeb6e888e6c tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:01.395519 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-09044f4c-9546-4151-82ea-8aeb6e888e6c tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:15:01.403597 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-09044f4c-9546-4151-82ea-8aeb6e888e6c tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1" status: 200 len: 1522 microversion: 2.1 time: 0.151842 Jul 28 18:15:01.404168 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 179/362] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:15:01 2022] GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:15:02.424325 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-2f2b4cf7-f2c2-4ad6-95cf-62342b1f2941 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:15:02.425610 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-2f2b4cf7-f2c2-4ad6-95cf-62342b1f2941 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:15:02.429116 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:02.433852 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2f2b4cf7-f2c2-4ad6-95cf-62342b1f2941 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:02.434303 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2f2b4cf7-f2c2-4ad6-95cf-62342b1f2941 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:02.435174 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2f2b4cf7-f2c2-4ad6-95cf-62342b1f2941 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:02.435513 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2f2b4cf7-f2c2-4ad6-95cf-62342b1f2941 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:02.439498 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:02.563509 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-2f2b4cf7-f2c2-4ad6-95cf-62342b1f2941 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:15:02.570974 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-2f2b4cf7-f2c2-4ad6-95cf-62342b1f2941 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1" status: 200 len: 1522 microversion: 2.1 time: 0.150617 Jul 28 18:15:02.571555 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 184/363] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:15:02 2022] GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:15:03.591980 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-7de58e7e-857a-442f-9e23-e91bc79be949 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:15:03.592604 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-7de58e7e-857a-442f-9e23-e91bc79be949 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:15:03.594509 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:03.599110 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7de58e7e-857a-442f-9e23-e91bc79be949 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:03.599556 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7de58e7e-857a-442f-9e23-e91bc79be949 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:03.600321 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7de58e7e-857a-442f-9e23-e91bc79be949 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:03.600760 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7de58e7e-857a-442f-9e23-e91bc79be949 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:03.738983 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-7de58e7e-857a-442f-9e23-e91bc79be949 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:15:03.747094 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-7de58e7e-857a-442f-9e23-e91bc79be949 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1" status: 200 len: 1522 microversion: 2.1 time: 0.159847 Jul 28 18:15:03.749430 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 180/364] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:15:03 2022] GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:15:04.768931 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-57a57f42-3a6f-40ea-8efa-f0ea45bfbfce tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:15:04.769600 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-57a57f42-3a6f-40ea-8efa-f0ea45bfbfce tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:15:04.777248 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-57a57f42-3a6f-40ea-8efa-f0ea45bfbfce tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:04.777773 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-57a57f42-3a6f-40ea-8efa-f0ea45bfbfce tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:04.778548 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-57a57f42-3a6f-40ea-8efa-f0ea45bfbfce tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:04.778995 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-57a57f42-3a6f-40ea-8efa-f0ea45bfbfce tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:04.909490 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-57a57f42-3a6f-40ea-8efa-f0ea45bfbfce tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:15:04.917206 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-57a57f42-3a6f-40ea-8efa-f0ea45bfbfce tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1" status: 200 len: 1522 microversion: 2.1 time: 0.152190 Jul 28 18:15:04.917780 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 185/365] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:15:04 2022] GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:15:05.938312 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-76f18223-8f7d-4fac-b0e0-d2b2c677bf47 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:15:05.938954 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-76f18223-8f7d-4fac-b0e0-d2b2c677bf47 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:15:05.945048 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-76f18223-8f7d-4fac-b0e0-d2b2c677bf47 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:05.945498 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-76f18223-8f7d-4fac-b0e0-d2b2c677bf47 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:05.946257 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-76f18223-8f7d-4fac-b0e0-d2b2c677bf47 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:05.946697 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-76f18223-8f7d-4fac-b0e0-d2b2c677bf47 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:06.081690 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-76f18223-8f7d-4fac-b0e0-d2b2c677bf47 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:15:06.089206 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-76f18223-8f7d-4fac-b0e0-d2b2c677bf47 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1" status: 200 len: 1522 microversion: 2.1 time: 0.155379 Jul 28 18:15:06.089777 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 181/366] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:15:05 2022] GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:15:07.110944 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-25b4b0dd-e1b2-4b32-b29c-f1ae0e75f812 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:15:07.111553 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-25b4b0dd-e1b2-4b32-b29c-f1ae0e75f812 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:15:07.118137 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-25b4b0dd-e1b2-4b32-b29c-f1ae0e75f812 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:07.118638 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-25b4b0dd-e1b2-4b32-b29c-f1ae0e75f812 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:07.119355 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-25b4b0dd-e1b2-4b32-b29c-f1ae0e75f812 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:07.119796 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-25b4b0dd-e1b2-4b32-b29c-f1ae0e75f812 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:07.249441 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-25b4b0dd-e1b2-4b32-b29c-f1ae0e75f812 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:15:07.258451 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-25b4b0dd-e1b2-4b32-b29c-f1ae0e75f812 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1" status: 200 len: 1522 microversion: 2.1 time: 0.151488 Jul 28 18:15:07.259132 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 186/367] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:15:07 2022] GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:15:08.281003 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3c38ae2c-a1bf-402b-88bd-5f78f0b4b967 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:15:08.281656 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3c38ae2c-a1bf-402b-88bd-5f78f0b4b967 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:15:08.287656 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3c38ae2c-a1bf-402b-88bd-5f78f0b4b967 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:08.288107 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3c38ae2c-a1bf-402b-88bd-5f78f0b4b967 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:08.288868 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3c38ae2c-a1bf-402b-88bd-5f78f0b4b967 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:08.289352 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3c38ae2c-a1bf-402b-88bd-5f78f0b4b967 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:08.420769 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-3c38ae2c-a1bf-402b-88bd-5f78f0b4b967 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:15:08.428353 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-3c38ae2c-a1bf-402b-88bd-5f78f0b4b967 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1" status: 200 len: 1522 microversion: 2.1 time: 0.151240 Jul 28 18:15:08.428921 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 182/368] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:15:08 2022] GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:15:09.449827 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-c0d45747-c716-4e44-ab7d-210743470d65 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:15:09.450440 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-c0d45747-c716-4e44-ab7d-210743470d65 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:15:09.457596 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c0d45747-c716-4e44-ab7d-210743470d65 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:09.458047 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c0d45747-c716-4e44-ab7d-210743470d65 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:09.458809 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c0d45747-c716-4e44-ab7d-210743470d65 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:09.459250 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c0d45747-c716-4e44-ab7d-210743470d65 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:09.589250 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-c0d45747-c716-4e44-ab7d-210743470d65 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:15:09.597004 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-c0d45747-c716-4e44-ab7d-210743470d65 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1" status: 200 len: 1522 microversion: 2.1 time: 0.150996 Jul 28 18:15:09.597572 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 187/369] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:15:09 2022] GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:15:10.617287 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d247326b-be80-4474-8701-1be1b63f862e tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:15:10.617893 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-d247326b-be80-4474-8701-1be1b63f862e tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:15:10.624527 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d247326b-be80-4474-8701-1be1b63f862e tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:10.624993 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d247326b-be80-4474-8701-1be1b63f862e tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:10.625758 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d247326b-be80-4474-8701-1be1b63f862e tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:10.626194 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d247326b-be80-4474-8701-1be1b63f862e tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:10.757256 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-d247326b-be80-4474-8701-1be1b63f862e tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:15:10.765306 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-d247326b-be80-4474-8701-1be1b63f862e tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1" status: 200 len: 1522 microversion: 2.1 time: 0.151899 Jul 28 18:15:10.765869 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 183/370] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:15:10 2022] GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:15:11.785761 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-540d5f52-e0ad-41d7-bc40-e6ff55f54543 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:15:11.786374 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-540d5f52-e0ad-41d7-bc40-e6ff55f54543 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:15:11.792834 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-540d5f52-e0ad-41d7-bc40-e6ff55f54543 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:11.793339 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-540d5f52-e0ad-41d7-bc40-e6ff55f54543 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:11.794102 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-540d5f52-e0ad-41d7-bc40-e6ff55f54543 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:11.794546 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-540d5f52-e0ad-41d7-bc40-e6ff55f54543 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:11.924052 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-540d5f52-e0ad-41d7-bc40-e6ff55f54543 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:15:11.931493 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-540d5f52-e0ad-41d7-bc40-e6ff55f54543 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1" status: 200 len: 1522 microversion: 2.1 time: 0.149605 Jul 28 18:15:11.932060 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 188/371] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:15:11 2022] GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:15:12.952387 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-cae48a90-7181-48e7-88fd-6f93fcf0917a tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:15:12.953051 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-cae48a90-7181-48e7-88fd-6f93fcf0917a tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:15:12.959514 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cae48a90-7181-48e7-88fd-6f93fcf0917a tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:12.959942 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cae48a90-7181-48e7-88fd-6f93fcf0917a tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:12.960698 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cae48a90-7181-48e7-88fd-6f93fcf0917a tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:12.961168 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cae48a90-7181-48e7-88fd-6f93fcf0917a tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:13.088775 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-cae48a90-7181-48e7-88fd-6f93fcf0917a tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:15:13.097143 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-cae48a90-7181-48e7-88fd-6f93fcf0917a tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1" status: 200 len: 1522 microversion: 2.1 time: 0.148587 Jul 28 18:15:13.097705 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 184/372] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:15:12 2022] GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:15:14.118313 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-1a285416-a968-47e5-b363-db8920b467d0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:15:14.118915 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-1a285416-a968-47e5-b363-db8920b467d0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:15:14.125367 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-1a285416-a968-47e5-b363-db8920b467d0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:14.125813 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-1a285416-a968-47e5-b363-db8920b467d0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:14.126587 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-1a285416-a968-47e5-b363-db8920b467d0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:14.127080 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-1a285416-a968-47e5-b363-db8920b467d0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:14.253348 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-1a285416-a968-47e5-b363-db8920b467d0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:15:14.260870 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-1a285416-a968-47e5-b363-db8920b467d0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1" status: 200 len: 1522 microversion: 2.1 time: 0.146382 Jul 28 18:15:14.261476 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 189/373] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:15:14 2022] GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:15:15.282417 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-014d0f3d-93f1-4b95-b09e-f173938bf3a4 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:15:15.283055 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-014d0f3d-93f1-4b95-b09e-f173938bf3a4 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:15:15.289129 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-014d0f3d-93f1-4b95-b09e-f173938bf3a4 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:15.289584 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-014d0f3d-93f1-4b95-b09e-f173938bf3a4 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:15.290348 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-014d0f3d-93f1-4b95-b09e-f173938bf3a4 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:15.290789 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-014d0f3d-93f1-4b95-b09e-f173938bf3a4 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:15.439793 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-014d0f3d-93f1-4b95-b09e-f173938bf3a4 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:15:15.448423 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-014d0f3d-93f1-4b95-b09e-f173938bf3a4 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1" status: 200 len: 1522 microversion: 2.1 time: 0.169993 Jul 28 18:15:15.453071 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 185/374] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:15:15 2022] GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:15:16.471464 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-e4e87bec-6d91-41bc-8661-ad3e3558e543 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:15:16.472287 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-e4e87bec-6d91-41bc-8661-ad3e3558e543 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:15:16.479880 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e4e87bec-6d91-41bc-8661-ad3e3558e543 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:16.480418 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e4e87bec-6d91-41bc-8661-ad3e3558e543 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:16.481332 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e4e87bec-6d91-41bc-8661-ad3e3558e543 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:16.482129 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e4e87bec-6d91-41bc-8661-ad3e3558e543 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:16.647710 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-e4e87bec-6d91-41bc-8661-ad3e3558e543 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:15:16.658027 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-e4e87bec-6d91-41bc-8661-ad3e3558e543 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1" status: 200 len: 1522 microversion: 2.1 time: 0.190559 Jul 28 18:15:16.659894 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 190/375] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:15:16 2022] GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:15:17.690413 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-eb0663c1-7240-4444-8892-324ee8b154a7 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:15:17.691851 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-eb0663c1-7240-4444-8892-324ee8b154a7 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:15:17.700409 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-eb0663c1-7240-4444-8892-324ee8b154a7 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:17.701312 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-eb0663c1-7240-4444-8892-324ee8b154a7 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:17.702448 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-eb0663c1-7240-4444-8892-324ee8b154a7 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:17.703411 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-eb0663c1-7240-4444-8892-324ee8b154a7 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:17.875358 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-eb0663c1-7240-4444-8892-324ee8b154a7 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:15:17.883838 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-eb0663c1-7240-4444-8892-324ee8b154a7 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1" status: 200 len: 1522 microversion: 2.1 time: 0.199993 Jul 28 18:15:17.884413 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 186/376] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:15:17 2022] GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:15:18.905222 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-629b9746-5166-403b-ad41-d9c16ce5a90f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:15:18.905864 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-629b9746-5166-403b-ad41-d9c16ce5a90f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:15:18.913119 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-629b9746-5166-403b-ad41-d9c16ce5a90f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:18.913571 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-629b9746-5166-403b-ad41-d9c16ce5a90f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:18.914340 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-629b9746-5166-403b-ad41-d9c16ce5a90f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:18.914783 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-629b9746-5166-403b-ad41-d9c16ce5a90f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:19.043036 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-629b9746-5166-403b-ad41-d9c16ce5a90f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:15:19.050463 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-629b9746-5166-403b-ad41-d9c16ce5a90f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1" status: 200 len: 1522 microversion: 2.1 time: 0.149132 Jul 28 18:15:19.051025 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 191/377] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:15:18 2022] GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:15:20.071300 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-8380e30d-9da0-49de-bfab-ab0105b06e72 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:15:20.071829 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-8380e30d-9da0-49de-bfab-ab0105b06e72 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:15:20.077907 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8380e30d-9da0-49de-bfab-ab0105b06e72 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:20.078359 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8380e30d-9da0-49de-bfab-ab0105b06e72 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:20.079122 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8380e30d-9da0-49de-bfab-ab0105b06e72 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:20.079566 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8380e30d-9da0-49de-bfab-ab0105b06e72 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:20.209511 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8380e30d-9da0-49de-bfab-ab0105b06e72 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:15:20.217909 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-8380e30d-9da0-49de-bfab-ab0105b06e72 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1" status: 200 len: 1522 microversion: 2.1 time: 0.149948 Jul 28 18:15:20.218008 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 187/378] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:15:20 2022] GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:15:21.238475 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-51755ebc-4d86-4b94-aa12-2bf981f5e8e1 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:15:21.239047 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-51755ebc-4d86-4b94-aa12-2bf981f5e8e1 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:15:21.245626 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-51755ebc-4d86-4b94-aa12-2bf981f5e8e1 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:21.246081 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-51755ebc-4d86-4b94-aa12-2bf981f5e8e1 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:21.246880 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-51755ebc-4d86-4b94-aa12-2bf981f5e8e1 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:21.247327 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-51755ebc-4d86-4b94-aa12-2bf981f5e8e1 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:21.375390 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-51755ebc-4d86-4b94-aa12-2bf981f5e8e1 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:15:21.382807 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-51755ebc-4d86-4b94-aa12-2bf981f5e8e1 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1" status: 200 len: 1522 microversion: 2.1 time: 0.148792 Jul 28 18:15:21.383371 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 192/379] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:15:21 2022] GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:15:22.403235 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-2abd69f7-2039-4a78-a1ee-bf1498d9c114 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:15:22.403840 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-2abd69f7-2039-4a78-a1ee-bf1498d9c114 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:15:22.409977 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2abd69f7-2039-4a78-a1ee-bf1498d9c114 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:22.410424 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2abd69f7-2039-4a78-a1ee-bf1498d9c114 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:22.411180 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2abd69f7-2039-4a78-a1ee-bf1498d9c114 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:22.411621 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2abd69f7-2039-4a78-a1ee-bf1498d9c114 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:22.538548 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-2abd69f7-2039-4a78-a1ee-bf1498d9c114 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:15:22.545950 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-2abd69f7-2039-4a78-a1ee-bf1498d9c114 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1" status: 200 len: 1522 microversion: 2.1 time: 0.146543 Jul 28 18:15:22.546504 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 188/380] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:15:22 2022] GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:15:23.567220 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-2be744d2-5093-4345-8aac-2f8d8fbeb94f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:15:23.568448 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-2be744d2-5093-4345-8aac-2f8d8fbeb94f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:15:23.579633 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2be744d2-5093-4345-8aac-2f8d8fbeb94f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:23.580079 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2be744d2-5093-4345-8aac-2f8d8fbeb94f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:23.580844 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2be744d2-5093-4345-8aac-2f8d8fbeb94f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:23.581809 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2be744d2-5093-4345-8aac-2f8d8fbeb94f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:23.711508 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-2be744d2-5093-4345-8aac-2f8d8fbeb94f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:15:23.719426 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-2be744d2-5093-4345-8aac-2f8d8fbeb94f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1" status: 200 len: 1522 microversion: 2.1 time: 0.156166 Jul 28 18:15:23.719996 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 193/381] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:15:23 2022] GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:15:24.743859 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5733c2dd-3a1b-4052-9bc8-87210b5edaaa tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:15:24.744675 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-5733c2dd-3a1b-4052-9bc8-87210b5edaaa tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:15:24.751336 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5733c2dd-3a1b-4052-9bc8-87210b5edaaa tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:24.751792 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5733c2dd-3a1b-4052-9bc8-87210b5edaaa tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:24.752897 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5733c2dd-3a1b-4052-9bc8-87210b5edaaa tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:24.753418 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5733c2dd-3a1b-4052-9bc8-87210b5edaaa tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:24.908719 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-5733c2dd-3a1b-4052-9bc8-87210b5edaaa tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:15:24.917134 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-5733c2dd-3a1b-4052-9bc8-87210b5edaaa tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1" status: 200 len: 1522 microversion: 2.1 time: 0.180562 Jul 28 18:15:24.917714 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 189/382] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:15:24 2022] GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:15:25.938310 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-ac453d03-eda2-40a6-809a-82d3c960b704 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:15:25.938934 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-ac453d03-eda2-40a6-809a-82d3c960b704 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:15:25.945839 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ac453d03-eda2-40a6-809a-82d3c960b704 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:25.946516 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ac453d03-eda2-40a6-809a-82d3c960b704 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:25.947330 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ac453d03-eda2-40a6-809a-82d3c960b704 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:25.947764 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ac453d03-eda2-40a6-809a-82d3c960b704 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:26.091435 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-ac453d03-eda2-40a6-809a-82d3c960b704 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:15:26.100716 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-ac453d03-eda2-40a6-809a-82d3c960b704 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1" status: 200 len: 1522 microversion: 2.1 time: 0.166420 Jul 28 18:15:26.106179 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 194/383] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:15:25 2022] GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:15:27.129359 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-59366cbb-e113-4700-b2da-d73f5476642b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:15:27.129359 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-59366cbb-e113-4700-b2da-d73f5476642b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:15:27.129359 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-59366cbb-e113-4700-b2da-d73f5476642b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:27.130794 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-59366cbb-e113-4700-b2da-d73f5476642b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:27.130794 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-59366cbb-e113-4700-b2da-d73f5476642b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:27.131076 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-59366cbb-e113-4700-b2da-d73f5476642b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:27.268487 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-59366cbb-e113-4700-b2da-d73f5476642b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:15:27.276755 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-59366cbb-e113-4700-b2da-d73f5476642b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1" status: 200 len: 1522 microversion: 2.1 time: 0.158464 Jul 28 18:15:27.277435 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 190/384] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:15:27 2022] GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:15:28.306395 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-01d5f0a5-74b2-4388-b392-bc229098c8a0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:15:28.306395 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-01d5f0a5-74b2-4388-b392-bc229098c8a0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:15:28.308681 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-01d5f0a5-74b2-4388-b392-bc229098c8a0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:28.309183 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-01d5f0a5-74b2-4388-b392-bc229098c8a0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:28.310204 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-01d5f0a5-74b2-4388-b392-bc229098c8a0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:28.310651 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-01d5f0a5-74b2-4388-b392-bc229098c8a0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:28.443994 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-01d5f0a5-74b2-4388-b392-bc229098c8a0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:15:28.451621 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-01d5f0a5-74b2-4388-b392-bc229098c8a0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1" status: 200 len: 1522 microversion: 2.1 time: 0.156227 Jul 28 18:15:28.452193 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 195/385] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:15:28 2022] GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:15:29.473539 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-9de053b0-7183-4026-ba70-361a46f0f7e8 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:15:29.474147 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-9de053b0-7183-4026-ba70-361a46f0f7e8 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:15:29.483061 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9de053b0-7183-4026-ba70-361a46f0f7e8 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:29.483514 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9de053b0-7183-4026-ba70-361a46f0f7e8 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:29.484283 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9de053b0-7183-4026-ba70-361a46f0f7e8 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:29.484755 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9de053b0-7183-4026-ba70-361a46f0f7e8 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:29.648061 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-9de053b0-7183-4026-ba70-361a46f0f7e8 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:15:29.656165 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-9de053b0-7183-4026-ba70-361a46f0f7e8 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1" status: 200 len: 1522 microversion: 2.1 time: 0.186469 Jul 28 18:15:29.657084 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 191/386] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:15:29 2022] GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:15:30.677464 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-6e07b3ff-ce32-496a-924c-072ef8c92f93 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:15:30.678792 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-6e07b3ff-ce32-496a-924c-072ef8c92f93 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:15:30.687224 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-6e07b3ff-ce32-496a-924c-072ef8c92f93 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:30.687688 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-6e07b3ff-ce32-496a-924c-072ef8c92f93 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:30.688449 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-6e07b3ff-ce32-496a-924c-072ef8c92f93 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:30.688888 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-6e07b3ff-ce32-496a-924c-072ef8c92f93 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:30.833522 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-6e07b3ff-ce32-496a-924c-072ef8c92f93 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:15:30.842070 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-6e07b3ff-ce32-496a-924c-072ef8c92f93 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1" status: 200 len: 1522 microversion: 2.1 time: 0.169151 Jul 28 18:15:30.855836 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 196/387] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:15:30 2022] GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:15:31.864131 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-895c50b3-28e5-488f-9ccd-9268339d08f0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:15:31.865591 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-895c50b3-28e5-488f-9ccd-9268339d08f0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:15:31.872016 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-895c50b3-28e5-488f-9ccd-9268339d08f0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:31.872465 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-895c50b3-28e5-488f-9ccd-9268339d08f0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:31.873532 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-895c50b3-28e5-488f-9ccd-9268339d08f0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:31.874130 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-895c50b3-28e5-488f-9ccd-9268339d08f0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:32.251631 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-895c50b3-28e5-488f-9ccd-9268339d08f0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:15:32.261531 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-895c50b3-28e5-488f-9ccd-9268339d08f0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1" status: 200 len: 1522 microversion: 2.1 time: 0.401631 Jul 28 18:15:32.262410 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 192/388] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:15:31 2022] GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 => generated 1522 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:15:33.286759 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-b3fa8439-5523-49e3-9c78-02997db3adee tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:15:33.288098 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-b3fa8439-5523-49e3-9c78-02997db3adee tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:15:33.296043 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b3fa8439-5523-49e3-9c78-02997db3adee tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:33.297710 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b3fa8439-5523-49e3-9c78-02997db3adee tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:33.302941 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b3fa8439-5523-49e3-9c78-02997db3adee tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:33.304787 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b3fa8439-5523-49e3-9c78-02997db3adee tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:33.492054 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-b3fa8439-5523-49e3-9c78-02997db3adee tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:15:33.500236 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-b3fa8439-5523-49e3-9c78-02997db3adee tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1" status: 200 len: 1522 microversion: 2.1 time: 0.219982 Jul 28 18:15:33.500825 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 197/389] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:15:33 2022] GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:15:34.522970 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f149ec67-0dcb-49f4-8e7f-6f2185acef09 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:15:34.523589 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f149ec67-0dcb-49f4-8e7f-6f2185acef09 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:15:34.530986 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=26 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:34.533932 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f149ec67-0dcb-49f4-8e7f-6f2185acef09 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:34.536329 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f149ec67-0dcb-49f4-8e7f-6f2185acef09 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:34.538851 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f149ec67-0dcb-49f4-8e7f-6f2185acef09 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:34.539338 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f149ec67-0dcb-49f4-8e7f-6f2185acef09 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:34.550472 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=86 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:34.716118 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f149ec67-0dcb-49f4-8e7f-6f2185acef09 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:15:34.734077 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f149ec67-0dcb-49f4-8e7f-6f2185acef09 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1" status: 200 len: 1522 microversion: 2.1 time: 0.215827 Jul 28 18:15:34.735307 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 193/390] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:15:34 2022] GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:15:35.755564 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-8529bf32-4e1a-471d-ae3f-dce2514d3bc0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:15:35.756187 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-8529bf32-4e1a-471d-ae3f-dce2514d3bc0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:15:35.758773 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_api:SELECT=28 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:35.763709 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-8529bf32-4e1a-471d-ae3f-dce2514d3bc0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:35.764168 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-8529bf32-4e1a-471d-ae3f-dce2514d3bc0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:35.764999 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-8529bf32-4e1a-471d-ae3f-dce2514d3bc0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:35.765447 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-8529bf32-4e1a-471d-ae3f-dce2514d3bc0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:35.770014 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell1:SELECT=83 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:35.915264 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-8529bf32-4e1a-471d-ae3f-dce2514d3bc0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:15:35.923435 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-8529bf32-4e1a-471d-ae3f-dce2514d3bc0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1" status: 200 len: 1502 microversion: 2.1 time: 0.171505 Jul 28 18:15:35.937552 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 198/391] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:15:35 2022] GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 => generated 1502 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:15:35.943526 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-214237c3-a1b8-4c9f-8e94-650482452f1c tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e57b6f1a-1d54-4949-ae4f-ca86c4649511"}} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:15:35.945942 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-214237c3-a1b8-4c9f-8e94-650482452f1c tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:15:35.951839 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-214237c3-a1b8-4c9f-8e94-650482452f1c tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:35.952290 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-214237c3-a1b8-4c9f-8e94-650482452f1c tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:35.953127 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-214237c3-a1b8-4c9f-8e94-650482452f1c tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:35.953570 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-214237c3-a1b8-4c9f-8e94-650482452f1c tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:35.976883 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.wsgi [None req-214237c3-a1b8-4c9f-8e94-650482452f1c tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] HTTP exception thrown: Cannot 'attach_volume' instance 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 while it is in vm_state rescued Jul 28 18:15:35.980433 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-214237c3-a1b8-4c9f-8e94-650482452f1c tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Request method failure captured: Jul 28 18:15:35.980433 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: request: POST /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1/os-volume_attachments HTTP/1.1 Jul 28 18:15:35.980433 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Accept: application/json Jul 28 18:15:35.980433 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Accept-Encoding: identity Jul 28 18:15:35.980433 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Connection: close Jul 28 18:15:35.980433 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Content-Length: 74 Jul 28 18:15:35.980433 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Content-Type: application/json Jul 28 18:15:35.980433 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Host: 10.222.0.86 Jul 28 18:15:35.980433 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Openstack-System-Scope: None Jul 28 18:15:35.980433 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: User-Agent: python-urllib3/1.26.10 Jul 28 18:15:35.980433 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Auth-Token: gAAAAABi4tGak9iMP6i4DT42V1NnqmCZswp-XsfRnXwgZ5TInbJk7FNT9dOnhbjnqjtBLXPdrsj1TUIXXmpk6dZ3xWlxYxbYapUjkHD0Drg44UTheFQ5ZV9AjLn6l50Z1n5iufsCuAsTGkiWhMhNQDT75zNabsY87wD-531cxucsWWBAMcMaNMQ Jul 28 18:15:35.980433 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Domain-Id: None Jul 28 18:15:35.980433 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Domain-Name: None Jul 28 18:15:35.980433 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Identity-Status: Confirmed Jul 28 18:15:35.980433 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Is-Admin-Project: True Jul 28 18:15:35.980433 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Id: default Jul 28 18:15:35.980433 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Name: Default Jul 28 18:15:35.980433 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Id: b52f26ab8b934756b0c74d681d08d04f Jul 28 18:15:35.980433 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1347813421 Jul 28 18:15:35.980433 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Role: member,reader Jul 28 18:15:35.980433 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Roles: member,reader Jul 28 18:15:35.982044 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_b52f26ab8b934756b0c74d681d08d04f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/b52f26ab8b934756b0c74d681d08d04f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/b52f26ab8b934756b0c74d681d08d04f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/b52f26ab8b934756b0c74d681d08d04f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}] Jul 28 18:15:35.982044 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1347813421 Jul 28 18:15:35.982044 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant-Id: b52f26ab8b934756b0c74d681d08d04f Jul 28 18:15:35.982044 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1347813421 Jul 28 18:15:35.982044 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User: tempest-ServerRescueNegativeTestJSON-1347813421-project Jul 28 18:15:35.982044 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Id: default Jul 28 18:15:35.982044 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Name: Default Jul 28 18:15:35.982044 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Id: 5ef698c4f57f44d387550921a288d7ab Jul 28 18:15:35.982044 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1347813421-project Jul 28 18:15:35.982044 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Jul 28 18:15:35.982044 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: {"volumeAttachment": {"volumeId": "e57b6f1a-1d54-4949-ae4f-ca86c4649511"}} Jul 28 18:15:35.982044 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: method: > Jul 28 18:15:35.982994 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: exception: Cannot 'attach_volume' instance 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 while it is in vm_state rescued Jul 28 18:15:35.982994 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: action_args: {'server_id': '7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1', 'body': {'volumeAttachment': {'volumeId': 'e57b6f1a-1d54-4949-ae4f-ca86c4649511'}}} Jul 28 18:15:35.982994 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:15:35.982994 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:15:35.982994 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 28 18:15:35.982994 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 28 18:15:35.982994 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 18:15:35.982994 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 18:15:35.982994 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Jul 28 18:15:35.982994 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 28 18:15:35.982994 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 28 18:15:35.982994 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:15:35.982994 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:15:35.982994 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:15:35.982994 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:15:35.982994 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:15:35.982994 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:15:35.982994 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:15:35.982994 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:15:35.984239 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:15:35.984239 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:15:35.984239 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 18:15:35.984239 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 18:15:35.984239 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 18:15:35.984239 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 18:15:35.984239 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 18:15:35.984239 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 18:15:35.984239 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 28 18:15:35.984239 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 28 18:15:35.984239 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 28 18:15:35.984239 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 28 18:15:35.984239 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 while it is in vm_state rescued Jul 28 18:15:35.984239 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:15:35.984239 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:15:35.984239 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:15:35.984239 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:15:35.984239 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:15:35.984239 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:15:35.985393 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:15:35.985393 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:15:35.985393 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 while it is in vm_state rescued Jul 28 18:15:35.985393 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:15:35.985393 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-214237c3-a1b8-4c9f-8e94-650482452f1c tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Returning 409 to user: Cannot 'attach_volume' instance 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 while it is in vm_state rescued {{(pid=118453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:15:35.985393 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-214237c3-a1b8-4c9f-8e94-650482452f1c tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "POST /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.040472 Jul 28 18:15:35.985393 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 194/392] 10.222.0.86 () {60 vars in 1323 bytes} [Thu Jul 28 18:15:35 2022] POST /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1/os-volume_attachments => generated 152 bytes in 41 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 28 18:15:35.989358 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-a3dcde24-0a37-4bf4-a6e3-145b04b25d70 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:15:35.989896 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-a3dcde24-0a37-4bf4-a6e3-145b04b25d70 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:15:35.995864 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a3dcde24-0a37-4bf4-a6e3-145b04b25d70 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:35.996312 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a3dcde24-0a37-4bf4-a6e3-145b04b25d70 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:35.997337 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a3dcde24-0a37-4bf4-a6e3-145b04b25d70 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:35.997993 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a3dcde24-0a37-4bf4-a6e3-145b04b25d70 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:36.225888 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-a3dcde24-0a37-4bf4-a6e3-145b04b25d70 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "POST /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1/action" status: 202 len: 0 microversion: 2.1 time: 0.240366 Jul 28 18:15:36.229677 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 199/393] 10.222.0.86 () {60 vars in 1278 bytes} [Thu Jul 28 18:15:35 2022] POST /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 18:15:36.234950 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-755041ca-061c-4e4b-bb54-da7befb5e48d tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:15:36.235425 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-755041ca-061c-4e4b-bb54-da7befb5e48d tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:15:36.242466 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-755041ca-061c-4e4b-bb54-da7befb5e48d tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:36.242931 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-755041ca-061c-4e4b-bb54-da7befb5e48d tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:36.243899 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-755041ca-061c-4e4b-bb54-da7befb5e48d tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:36.244538 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-755041ca-061c-4e4b-bb54-da7befb5e48d tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:36.434974 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-755041ca-061c-4e4b-bb54-da7befb5e48d tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:15:36.454714 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-755041ca-061c-4e4b-bb54-da7befb5e48d tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1" status: 200 len: 1510 microversion: 2.1 time: 0.223751 Jul 28 18:15:36.455312 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 195/394] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:15:36 2022] GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 => generated 1510 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:15:37.477646 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-a77ee07f-04df-434f-8e13-f32b9092eed9 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:15:37.478266 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-a77ee07f-04df-434f-8e13-f32b9092eed9 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:15:37.485362 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a77ee07f-04df-434f-8e13-f32b9092eed9 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:37.486081 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a77ee07f-04df-434f-8e13-f32b9092eed9 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:37.487054 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a77ee07f-04df-434f-8e13-f32b9092eed9 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:37.488312 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a77ee07f-04df-434f-8e13-f32b9092eed9 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:37.661009 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-a77ee07f-04df-434f-8e13-f32b9092eed9 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:15:37.670090 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-a77ee07f-04df-434f-8e13-f32b9092eed9 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1" status: 200 len: 1510 microversion: 2.1 time: 0.198030 Jul 28 18:15:37.670951 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 200/395] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:15:37 2022] GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 => generated 1510 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:15:38.695118 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-1e5ba5f9-d429-4ad7-9ddc-7a1f3a7dc6da tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:15:38.695118 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-1e5ba5f9-d429-4ad7-9ddc-7a1f3a7dc6da tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:15:38.699139 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1e5ba5f9-d429-4ad7-9ddc-7a1f3a7dc6da tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:38.699595 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1e5ba5f9-d429-4ad7-9ddc-7a1f3a7dc6da tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:38.700355 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1e5ba5f9-d429-4ad7-9ddc-7a1f3a7dc6da tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:38.700801 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1e5ba5f9-d429-4ad7-9ddc-7a1f3a7dc6da tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:38.840723 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-1e5ba5f9-d429-4ad7-9ddc-7a1f3a7dc6da tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:15:38.850861 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-1e5ba5f9-d429-4ad7-9ddc-7a1f3a7dc6da tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1" status: 200 len: 1510 microversion: 2.1 time: 0.162046 Jul 28 18:15:38.851762 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 196/396] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:15:38 2022] GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 => generated 1510 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:15:39.877386 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-efa12813-4847-4c7a-8823-4107ac671ea5 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:15:39.878507 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-efa12813-4847-4c7a-8823-4107ac671ea5 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:15:39.885021 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-efa12813-4847-4c7a-8823-4107ac671ea5 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:39.885485 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-efa12813-4847-4c7a-8823-4107ac671ea5 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:39.886250 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-efa12813-4847-4c7a-8823-4107ac671ea5 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:39.886693 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-efa12813-4847-4c7a-8823-4107ac671ea5 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:40.012600 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-efa12813-4847-4c7a-8823-4107ac671ea5 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:15:40.020712 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-efa12813-4847-4c7a-8823-4107ac671ea5 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1" status: 200 len: 1510 microversion: 2.1 time: 0.147249 Jul 28 18:15:40.021309 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 201/397] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:15:39 2022] GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 => generated 1510 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:15:41.041319 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-fc40707c-8bd4-4843-ad81-17c56af81261 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:15:41.041934 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-fc40707c-8bd4-4843-ad81-17c56af81261 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:15:41.047830 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fc40707c-8bd4-4843-ad81-17c56af81261 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:41.048279 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fc40707c-8bd4-4843-ad81-17c56af81261 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:41.049066 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fc40707c-8bd4-4843-ad81-17c56af81261 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:41.049506 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fc40707c-8bd4-4843-ad81-17c56af81261 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:41.175462 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-fc40707c-8bd4-4843-ad81-17c56af81261 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:15:41.182900 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-fc40707c-8bd4-4843-ad81-17c56af81261 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1" status: 200 len: 1510 microversion: 2.1 time: 0.145386 Jul 28 18:15:41.183459 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 197/398] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:15:41 2022] GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 => generated 1510 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:15:42.203915 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-af4b3b62-b60c-4040-917c-a5a80e6b651c tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:15:42.204603 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-af4b3b62-b60c-4040-917c-a5a80e6b651c tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:15:42.211210 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-af4b3b62-b60c-4040-917c-a5a80e6b651c tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:42.211658 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-af4b3b62-b60c-4040-917c-a5a80e6b651c tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:42.212420 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-af4b3b62-b60c-4040-917c-a5a80e6b651c tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:42.212889 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-af4b3b62-b60c-4040-917c-a5a80e6b651c tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:42.343244 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-af4b3b62-b60c-4040-917c-a5a80e6b651c tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:15:42.351337 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-af4b3b62-b60c-4040-917c-a5a80e6b651c tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1" status: 200 len: 1510 microversion: 2.1 time: 0.151306 Jul 28 18:15:42.351905 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 202/399] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:15:42 2022] GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:15:43.373143 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-89aefc54-a77f-4096-b75b-ab87b5c012ee tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:15:43.373629 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-89aefc54-a77f-4096-b75b-ab87b5c012ee tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:15:43.379771 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-89aefc54-a77f-4096-b75b-ab87b5c012ee tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:43.381973 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-89aefc54-a77f-4096-b75b-ab87b5c012ee tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:43.381973 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-89aefc54-a77f-4096-b75b-ab87b5c012ee tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:43.381973 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-89aefc54-a77f-4096-b75b-ab87b5c012ee tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:43.546112 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-89aefc54-a77f-4096-b75b-ab87b5c012ee tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:15:43.554608 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-89aefc54-a77f-4096-b75b-ab87b5c012ee tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1" status: 200 len: 1510 microversion: 2.1 time: 0.185428 Jul 28 18:15:43.555187 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 198/400] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:15:43 2022] GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 => generated 1510 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:15:44.575686 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-2e9e5c0b-1154-4958-a35a-02811cdfebdb tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:15:44.576325 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-2e9e5c0b-1154-4958-a35a-02811cdfebdb tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:15:44.583566 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2e9e5c0b-1154-4958-a35a-02811cdfebdb tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:44.584035 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2e9e5c0b-1154-4958-a35a-02811cdfebdb tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:44.584808 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2e9e5c0b-1154-4958-a35a-02811cdfebdb tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:44.585274 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2e9e5c0b-1154-4958-a35a-02811cdfebdb tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:44.722153 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-2e9e5c0b-1154-4958-a35a-02811cdfebdb tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:15:44.730515 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-2e9e5c0b-1154-4958-a35a-02811cdfebdb tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1" status: 200 len: 1510 microversion: 2.1 time: 0.158704 Jul 28 18:15:44.731093 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 203/401] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:15:44 2022] GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:15:45.756701 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-44bce5f2-dbe0-4c1d-b1cd-dfd378e9289a tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:15:45.756701 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-44bce5f2-dbe0-4c1d-b1cd-dfd378e9289a tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:15:45.758422 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-44bce5f2-dbe0-4c1d-b1cd-dfd378e9289a tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:45.758879 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-44bce5f2-dbe0-4c1d-b1cd-dfd378e9289a tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:45.759652 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-44bce5f2-dbe0-4c1d-b1cd-dfd378e9289a tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:45.760369 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-44bce5f2-dbe0-4c1d-b1cd-dfd378e9289a tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:45.892368 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-44bce5f2-dbe0-4c1d-b1cd-dfd378e9289a tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:15:45.899960 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-44bce5f2-dbe0-4c1d-b1cd-dfd378e9289a tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1" status: 200 len: 1516 microversion: 2.1 time: 0.152533 Jul 28 18:15:45.900526 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 199/402] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:15:45 2022] GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:15:48.650809 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-4c91ee0f-61b4-4846-9b95-1fdfce276db5 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Action: 'create', calling method: .version_select at 0x7f6fe2652160>, body: {"keypair": {"name": "tempest-keypair-2069449035", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7Sbm97MKWX7VI+5t2uG+vXyCokeSRP7+1wqq6gYUIegzOTBRF/8g2G/+NwYqi71LqLlpeUysJpXmE20DZcf8Xk+h5ETgB/u/nlAYlDVRdujWZ7Z3shr7jZlVOtJL284g=="}} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:15:48.668196 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.quota [None req-4c91ee0f-61b4-4846-9b95-1fdfce276db5 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Getting quotas for project b52f26ab8b934756b0c74d681d08d04f. Resources: {'key_pairs'} {{(pid=118454) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 18:15:48.672427 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.quota [None req-4c91ee0f-61b4-4846-9b95-1fdfce276db5 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Getting quotas for user 5ef698c4f57f44d387550921a288d7ab and project b52f26ab8b934756b0c74d681d08d04f. Resources: {'key_pairs'} {{(pid=118454) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 18:15:48.683916 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4c91ee0f-61b4-4846-9b95-1fdfce276db5 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [1f036f57-13ae-4f9e-b66e-a4a1464a984c] AMQP server on 10.222.0.86:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 28 18:15:49.691176 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO oslo.messaging._drivers.impl_rabbit [None req-4c91ee0f-61b4-4846-9b95-1fdfce276db5 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [1f036f57-13ae-4f9e-b66e-a4a1464a984c] Reconnected to AMQP server on 10.222.0.86:5672 via [amqp] client with port 49032. Jul 28 18:15:49.793652 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-4c91ee0f-61b4-4846-9b95-1fdfce276db5 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.147395 Jul 28 18:15:49.799026 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 204/403] 10.222.0.86 () {60 vars in 1159 bytes} [Thu Jul 28 18:15:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:15:52.161079 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-e7928883-0d2c-48c1-8fbd-3b67f3cd6e62 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1678829282", "imageRef": "61912422-61cd-4ced-a573-85ee305e010f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ba65b4a3-37f5-43f6-818c-5327e758cd5c"}], "security_groups": [{"name": "tempest-securitygroup--1145749838"}], "key_name": "tempest-keypair-2069449035", "user_data": "}} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:15:52.263184 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.network.neutron [None req-e7928883-0d2c-48c1-8fbd-3b67f3cd6e62 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] validate_networks() for [('ba65b4a3-37f5-43f6-818c-5327e758cd5c', None, None, None, None, None)] {{(pid=118453) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 18:15:52.636345 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-e7928883-0d2c-48c1-8fbd-3b67f3cd6e62 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Flavor limits 0:0:0 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 18:15:52.636769 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-e7928883-0d2c-48c1-8fbd-3b67f3cd6e62 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Image limits 0:0:0 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 18:15:52.637290 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-e7928883-0d2c-48c1-8fbd-3b67f3cd6e62 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Flavor pref 0:0:0 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 18:15:52.637701 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-e7928883-0d2c-48c1-8fbd-3b67f3cd6e62 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Image pref 0:0:0 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 18:15:52.638110 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-e7928883-0d2c-48c1-8fbd-3b67f3cd6e62 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 18:15:52.646898 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e7928883-0d2c-48c1-8fbd-3b67f3cd6e62 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:52.647346 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e7928883-0d2c-48c1-8fbd-3b67f3cd6e62 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:52.648139 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e7928883-0d2c-48c1-8fbd-3b67f3cd6e62 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:52.648578 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e7928883-0d2c-48c1-8fbd-3b67f3cd6e62 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:52.666314 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.quota [None req-e7928883-0d2c-48c1-8fbd-3b67f3cd6e62 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Getting quotas for project b52f26ab8b934756b0c74d681d08d04f. Resources: {'cores', 'ram', 'instances'} {{(pid=118453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 18:15:52.670244 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.quota [None req-e7928883-0d2c-48c1-8fbd-3b67f3cd6e62 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Getting quotas for user 5ef698c4f57f44d387550921a288d7ab and project b52f26ab8b934756b0c74d681d08d04f. Resources: {'cores', 'ram', 'instances'} {{(pid=118453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 18:15:52.681556 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-e7928883-0d2c-48c1-8fbd-3b67f3cd6e62 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Going to run 1 instances... {{(pid=118453) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 18:15:52.683817 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-e7928883-0d2c-48c1-8fbd-3b67f3cd6e62 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 39af8515-9818-4664-9e32-7a8a318f02c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='61912422-61cd-4ced-a573-85ee305e010f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 18:15:52.805102 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e7928883-0d2c-48c1-8fbd-3b67f3cd6e62 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [9fc507cb-62e6-46b0-96e5-cba623eafec2] AMQP server on 10.222.0.86:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 28 18:15:53.811658 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO oslo.messaging._drivers.impl_rabbit [None req-e7928883-0d2c-48c1-8fbd-3b67f3cd6e62 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [9fc507cb-62e6-46b0-96e5-cba623eafec2] Reconnected to AMQP server on 10.222.0.86:5672 via [amqp] client with port 49114. Jul 28 18:15:53.815615 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-e7928883-0d2c-48c1-8fbd-3b67f3cd6e62 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.658828 Jul 28 18:15:53.816266 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 200/404] 10.222.0.86 () {60 vars in 1147 bytes} [Thu Jul 28 18:15:52 2022] POST /compute/v2.1/servers => generated 409 bytes in 1660 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 18:15:53.828329 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-27d12c07-3d66-42e3-a3c2-6febe63f5049 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:15:53.828947 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-27d12c07-3d66-42e3-a3c2-6febe63f5049 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 39af8515-9818-4664-9e32-7a8a318f02c6] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:15:53.882232 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-27d12c07-3d66-42e3-a3c2-6febe63f5049 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:15:53.888845 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-27d12c07-3d66-42e3-a3c2-6febe63f5049 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6" status: 200 len: 1246 microversion: 2.1 time: 0.065076 Jul 28 18:15:53.889453 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 205/405] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:15:53 2022] GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6 => generated 1246 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:15:54.912112 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-4799f711-0831-41f1-b496-8ed9973bdb43 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:15:54.912893 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-4799f711-0831-41f1-b496-8ed9973bdb43 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 39af8515-9818-4664-9e32-7a8a318f02c6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:15:54.919377 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4799f711-0831-41f1-b496-8ed9973bdb43 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:54.920199 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4799f711-0831-41f1-b496-8ed9973bdb43 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:54.921208 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4799f711-0831-41f1-b496-8ed9973bdb43 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:54.921653 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4799f711-0831-41f1-b496-8ed9973bdb43 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:54.994932 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-4799f711-0831-41f1-b496-8ed9973bdb43 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:15:55.002530 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-4799f711-0831-41f1-b496-8ed9973bdb43 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6" status: 200 len: 1250 microversion: 2.1 time: 0.095485 Jul 28 18:15:55.003291 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 201/406] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:15:54 2022] GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6 => generated 1250 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:15:56.031549 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-dd3e787f-4c36-43e7-b189-8d757f4d356f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:15:56.031973 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-dd3e787f-4c36-43e7-b189-8d757f4d356f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 39af8515-9818-4664-9e32-7a8a318f02c6] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:15:56.035150 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:56.040711 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-dd3e787f-4c36-43e7-b189-8d757f4d356f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:56.041208 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-dd3e787f-4c36-43e7-b189-8d757f4d356f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:56.041993 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-dd3e787f-4c36-43e7-b189-8d757f4d356f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:56.042441 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-dd3e787f-4c36-43e7-b189-8d757f4d356f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:56.109405 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-dd3e787f-4c36-43e7-b189-8d757f4d356f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:15:56.116698 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-dd3e787f-4c36-43e7-b189-8d757f4d356f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6" status: 200 len: 1298 microversion: 2.1 time: 0.091920 Jul 28 18:15:56.117299 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 206/407] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:15:56 2022] GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6 => generated 1298 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:15:57.137269 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-4a60201c-765f-4315-a080-c61b1c9ef720 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:15:57.137881 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-4a60201c-765f-4315-a080-c61b1c9ef720 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 39af8515-9818-4664-9e32-7a8a318f02c6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:15:57.145353 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4a60201c-765f-4315-a080-c61b1c9ef720 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:57.145644 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4a60201c-765f-4315-a080-c61b1c9ef720 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:57.149703 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4a60201c-765f-4315-a080-c61b1c9ef720 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:57.149703 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4a60201c-765f-4315-a080-c61b1c9ef720 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:57.325039 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-4a60201c-765f-4315-a080-c61b1c9ef720 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:15:57.336176 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-4a60201c-765f-4315-a080-c61b1c9ef720 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6" status: 200 len: 1372 microversion: 2.1 time: 0.201043 Jul 28 18:15:57.350395 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 202/408] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:15:57 2022] GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6 => generated 1372 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:15:58.180484 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [req-183ef243-0fc7-4a85-8439-68a7a40ceb79 req-abf8278b-9ea1-4e3b-bd0f-c9fa0381abcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39af8515-9818-4664-9e32-7a8a318f02c6", "tag": "f0dbd9bf-00f9-4a54-976e-f94921af3d46"}]} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:15:58.194313 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-183ef243-0fc7-4a85-8439-68a7a40ceb79 req-abf8278b-9ea1-4e3b-bd0f-c9fa0381abcb service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:58.194762 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-183ef243-0fc7-4a85-8439-68a7a40ceb79 req-abf8278b-9ea1-4e3b-bd0f-c9fa0381abcb service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:58.208003 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.compute.server_external_events [req-183ef243-0fc7-4a85-8439-68a7a40ceb79 req-abf8278b-9ea1-4e3b-bd0f-c9fa0381abcb service nova] Creating event network-changed:f0dbd9bf-00f9-4a54-976e-f94921af3d46 for instance 39af8515-9818-4664-9e32-7a8a318f02c6 on hv-cinder-84617 Jul 28 18:15:58.214629 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [req-183ef243-0fc7-4a85-8439-68a7a40ceb79 req-abf8278b-9ea1-4e3b-bd0f-c9fa0381abcb service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042551 Jul 28 18:15:58.215786 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 207/409] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:15:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:15:58.358309 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d40f6aa9-9261-4d3a-97d0-e29c7a243ff1 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:15:58.358925 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-d40f6aa9-9261-4d3a-97d0-e29c7a243ff1 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 39af8515-9818-4664-9e32-7a8a318f02c6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:15:58.367868 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d40f6aa9-9261-4d3a-97d0-e29c7a243ff1 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:58.368847 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d40f6aa9-9261-4d3a-97d0-e29c7a243ff1 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:58.369717 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d40f6aa9-9261-4d3a-97d0-e29c7a243ff1 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:58.370197 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d40f6aa9-9261-4d3a-97d0-e29c7a243ff1 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:58.597300 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-d40f6aa9-9261-4d3a-97d0-e29c7a243ff1 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:15:58.604673 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-d40f6aa9-9261-4d3a-97d0-e29c7a243ff1 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6" status: 200 len: 1372 microversion: 2.1 time: 0.250214 Jul 28 18:15:58.605292 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 203/410] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:15:58 2022] GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6 => generated 1372 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:15:59.627461 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-1ac97f2a-c8ed-42de-9bbf-ae30d2663118 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:15:59.628236 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-1ac97f2a-c8ed-42de-9bbf-ae30d2663118 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 39af8515-9818-4664-9e32-7a8a318f02c6] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:15:59.635108 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-1ac97f2a-c8ed-42de-9bbf-ae30d2663118 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:59.635558 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-1ac97f2a-c8ed-42de-9bbf-ae30d2663118 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:59.636321 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-1ac97f2a-c8ed-42de-9bbf-ae30d2663118 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:59.636755 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-1ac97f2a-c8ed-42de-9bbf-ae30d2663118 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:59.776019 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-1ac97f2a-c8ed-42de-9bbf-ae30d2663118 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:15:59.787320 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-1ac97f2a-c8ed-42de-9bbf-ae30d2663118 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6" status: 200 len: 1372 microversion: 2.1 time: 0.165759 Jul 28 18:15:59.787888 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 208/411] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:15:59 2022] GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6 => generated 1372 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:16:00.808601 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f6cfa61a-e4eb-4b48-9d76-5be2d7be7f81 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:16:00.809525 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f6cfa61a-e4eb-4b48-9d76-5be2d7be7f81 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 39af8515-9818-4664-9e32-7a8a318f02c6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:16:00.816398 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f6cfa61a-e4eb-4b48-9d76-5be2d7be7f81 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:00.817445 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f6cfa61a-e4eb-4b48-9d76-5be2d7be7f81 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:00.817886 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f6cfa61a-e4eb-4b48-9d76-5be2d7be7f81 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:00.820170 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f6cfa61a-e4eb-4b48-9d76-5be2d7be7f81 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:00.989736 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f6cfa61a-e4eb-4b48-9d76-5be2d7be7f81 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:00.997974 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f6cfa61a-e4eb-4b48-9d76-5be2d7be7f81 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6" status: 200 len: 1372 microversion: 2.1 time: 0.193464 Jul 28 18:16:00.998898 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 204/412] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:16:00 2022] GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6 => generated 1372 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:16:02.019112 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-520ec2fd-80a0-426a-b8c8-c33323d2b421 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:16:02.019745 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-520ec2fd-80a0-426a-b8c8-c33323d2b421 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 39af8515-9818-4664-9e32-7a8a318f02c6] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:16:02.026893 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-520ec2fd-80a0-426a-b8c8-c33323d2b421 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:02.027442 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-520ec2fd-80a0-426a-b8c8-c33323d2b421 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:02.028330 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-520ec2fd-80a0-426a-b8c8-c33323d2b421 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:02.028775 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-520ec2fd-80a0-426a-b8c8-c33323d2b421 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:02.172374 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-520ec2fd-80a0-426a-b8c8-c33323d2b421 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:02.180919 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-520ec2fd-80a0-426a-b8c8-c33323d2b421 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6" status: 200 len: 1372 microversion: 2.1 time: 0.166077 Jul 28 18:16:02.181524 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 209/413] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:16:02 2022] GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6 => generated 1372 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:16:03.203118 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-288bdd0c-ea26-4878-b561-f8fc1eadd00b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:16:03.203922 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-288bdd0c-ea26-4878-b561-f8fc1eadd00b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 39af8515-9818-4664-9e32-7a8a318f02c6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:16:03.205861 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell0:SELECT=2 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:03.206522 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell0:SELECT=6 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:03.212254 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-288bdd0c-ea26-4878-b561-f8fc1eadd00b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:03.212701 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-288bdd0c-ea26-4878-b561-f8fc1eadd00b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:03.213573 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-288bdd0c-ea26-4878-b561-f8fc1eadd00b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:03.214017 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-288bdd0c-ea26-4878-b561-f8fc1eadd00b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:03.351540 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-288bdd0c-ea26-4878-b561-f8fc1eadd00b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:03.359205 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-288bdd0c-ea26-4878-b561-f8fc1eadd00b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6" status: 200 len: 1372 microversion: 2.1 time: 0.160073 Jul 28 18:16:03.359829 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 205/414] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:16:03 2022] GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6 => generated 1372 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:16:04.380957 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-03a510d9-7173-4669-9410-d71ccf03e85b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:16:04.383889 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-03a510d9-7173-4669-9410-d71ccf03e85b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 39af8515-9818-4664-9e32-7a8a318f02c6] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:16:04.391287 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell0:SELECT=6 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:04.392806 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-03a510d9-7173-4669-9410-d71ccf03e85b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:04.393366 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-03a510d9-7173-4669-9410-d71ccf03e85b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:04.394571 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-03a510d9-7173-4669-9410-d71ccf03e85b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:04.395827 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-03a510d9-7173-4669-9410-d71ccf03e85b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:04.588203 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-03a510d9-7173-4669-9410-d71ccf03e85b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:04.598984 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-03a510d9-7173-4669-9410-d71ccf03e85b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6" status: 200 len: 1372 microversion: 2.1 time: 0.222312 Jul 28 18:16:04.602658 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 210/415] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:16:04 2022] GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6 => generated 1372 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:16:05.624948 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-6bb39f06-968c-41e5-aa21-7b9c084ee3a0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:16:05.625708 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-6bb39f06-968c-41e5-aa21-7b9c084ee3a0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 39af8515-9818-4664-9e32-7a8a318f02c6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:16:05.627697 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:05.633873 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6bb39f06-968c-41e5-aa21-7b9c084ee3a0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:05.634444 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6bb39f06-968c-41e5-aa21-7b9c084ee3a0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:05.635452 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6bb39f06-968c-41e5-aa21-7b9c084ee3a0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:05.636004 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6bb39f06-968c-41e5-aa21-7b9c084ee3a0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:05.640618 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=72 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:05.798544 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-6bb39f06-968c-41e5-aa21-7b9c084ee3a0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:05.806864 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-6bb39f06-968c-41e5-aa21-7b9c084ee3a0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6" status: 200 len: 1372 microversion: 2.1 time: 0.188690 Jul 28 18:16:05.807468 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 206/416] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:16:05 2022] GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6 => generated 1372 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:16:06.043030 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [req-9f5b0b0f-f756-45bb-a7bb-4db3400b4d1b req-4d143481-b90a-4784-86c8-718eee7cfe38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39af8515-9818-4664-9e32-7a8a318f02c6", "name": "network-vif-plugged", "status": "completed", "tag": "f0dbd9bf-00f9-4a54-976e-f94921af3d46"}]} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:16:06.049742 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:06.057217 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-9f5b0b0f-f756-45bb-a7bb-4db3400b4d1b req-4d143481-b90a-4784-86c8-718eee7cfe38 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:06.057756 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-9f5b0b0f-f756-45bb-a7bb-4db3400b4d1b req-4d143481-b90a-4784-86c8-718eee7cfe38 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:06.069299 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.compute.server_external_events [req-9f5b0b0f-f756-45bb-a7bb-4db3400b4d1b req-4d143481-b90a-4784-86c8-718eee7cfe38 service nova] Creating event network-vif-plugged:f0dbd9bf-00f9-4a54-976e-f94921af3d46 for instance 39af8515-9818-4664-9e32-7a8a318f02c6 on hv-cinder-84617 Jul 28 18:16:06.074628 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [req-9f5b0b0f-f756-45bb-a7bb-4db3400b4d1b req-4d143481-b90a-4784-86c8-718eee7cfe38 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035667 Jul 28 18:16:06.078914 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 211/417] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:16:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:16:06.828786 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-1c3ebd05-5ee3-4751-9eb0-301d5c51e7f6 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:16:06.829373 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-1c3ebd05-5ee3-4751-9eb0-301d5c51e7f6 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 39af8515-9818-4664-9e32-7a8a318f02c6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:16:06.836618 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1c3ebd05-5ee3-4751-9eb0-301d5c51e7f6 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:06.837073 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1c3ebd05-5ee3-4751-9eb0-301d5c51e7f6 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:06.838360 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1c3ebd05-5ee3-4751-9eb0-301d5c51e7f6 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:06.838360 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1c3ebd05-5ee3-4751-9eb0-301d5c51e7f6 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:06.972238 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-1c3ebd05-5ee3-4751-9eb0-301d5c51e7f6 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:06.981679 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-1c3ebd05-5ee3-4751-9eb0-301d5c51e7f6 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6" status: 200 len: 1372 microversion: 2.1 time: 0.157386 Jul 28 18:16:06.982250 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 207/418] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:16:06 2022] GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6 => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:16:08.005168 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-a1968d83-a7bb-4e9a-b443-ef94f61b4d63 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:16:08.005851 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-a1968d83-a7bb-4e9a-b443-ef94f61b4d63 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 39af8515-9818-4664-9e32-7a8a318f02c6] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:16:08.012324 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a1968d83-a7bb-4e9a-b443-ef94f61b4d63 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:08.012776 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a1968d83-a7bb-4e9a-b443-ef94f61b4d63 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:08.013628 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a1968d83-a7bb-4e9a-b443-ef94f61b4d63 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:08.014290 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a1968d83-a7bb-4e9a-b443-ef94f61b4d63 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:08.159478 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-a1968d83-a7bb-4e9a-b443-ef94f61b4d63 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:08.167601 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-a1968d83-a7bb-4e9a-b443-ef94f61b4d63 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6" status: 200 len: 1372 microversion: 2.1 time: 0.167511 Jul 28 18:16:08.168175 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 212/419] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:16:07 2022] GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6 => generated 1372 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:16:09.188209 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-11cdd626-161b-41da-99fd-751e6c8c72d9 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:16:09.188812 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-11cdd626-161b-41da-99fd-751e6c8c72d9 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 39af8515-9818-4664-9e32-7a8a318f02c6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:16:09.195288 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-11cdd626-161b-41da-99fd-751e6c8c72d9 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:09.195735 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-11cdd626-161b-41da-99fd-751e6c8c72d9 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:09.196523 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-11cdd626-161b-41da-99fd-751e6c8c72d9 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:09.196990 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-11cdd626-161b-41da-99fd-751e6c8c72d9 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:09.340997 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-11cdd626-161b-41da-99fd-751e6c8c72d9 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:09.349398 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-11cdd626-161b-41da-99fd-751e6c8c72d9 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6" status: 200 len: 1566 microversion: 2.1 time: 0.164463 Jul 28 18:16:09.350125 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 208/420] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:16:09 2022] GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6 => generated 1566 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:16:09.370346 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-806c37f1-8171-4bfe-a497-bcf183059d02 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:16:09.370889 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-806c37f1-8171-4bfe-a497-bcf183059d02 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 39af8515-9818-4664-9e32-7a8a318f02c6] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:16:09.377514 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-806c37f1-8171-4bfe-a497-bcf183059d02 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:09.377939 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-806c37f1-8171-4bfe-a497-bcf183059d02 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:09.378754 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-806c37f1-8171-4bfe-a497-bcf183059d02 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:09.379137 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-806c37f1-8171-4bfe-a497-bcf183059d02 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:09.460240 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-806c37f1-8171-4bfe-a497-bcf183059d02 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093948 Jul 28 18:16:09.461128 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 213/421] 10.222.0.86 () {58 vars in 1275 bytes} [Thu Jul 28 18:16:09 2022] GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:16:10.783717 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-6dbf4b95-2b1f-451b-b389-0c2866db840d req-b070c121-c4fd-4e3b-89e9-8e873f573d9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39af8515-9818-4664-9e32-7a8a318f02c6", "tag": "f0dbd9bf-00f9-4a54-976e-f94921af3d46"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:16:10.794857 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-6dbf4b95-2b1f-451b-b389-0c2866db840d req-b070c121-c4fd-4e3b-89e9-8e873f573d9e service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:10.795306 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-6dbf4b95-2b1f-451b-b389-0c2866db840d req-b070c121-c4fd-4e3b-89e9-8e873f573d9e service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:10.809265 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-6dbf4b95-2b1f-451b-b389-0c2866db840d req-b070c121-c4fd-4e3b-89e9-8e873f573d9e service nova] Creating event network-changed:f0dbd9bf-00f9-4a54-976e-f94921af3d46 for instance 39af8515-9818-4664-9e32-7a8a318f02c6 on hv-cinder-84617 Jul 28 18:16:10.819827 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-6dbf4b95-2b1f-451b-b389-0c2866db840d req-b070c121-c4fd-4e3b-89e9-8e873f573d9e service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036487 Jul 28 18:16:10.819827 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 209/422] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:16:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:16:30.857760 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_api:SELECT=5 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:30.858510 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell1:SELECT=38 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:30.863227 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-8e7c95f3-bd94-4c2f-89bb-48f4be7307f3 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:16:30.863718 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-8e7c95f3-bd94-4c2f-89bb-48f4be7307f3 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:16:30.870615 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-8e7c95f3-bd94-4c2f-89bb-48f4be7307f3 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:30.870981 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-8e7c95f3-bd94-4c2f-89bb-48f4be7307f3 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:30.871949 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-8e7c95f3-bd94-4c2f-89bb-48f4be7307f3 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:30.872381 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-8e7c95f3-bd94-4c2f-89bb-48f4be7307f3 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:30.900846 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-8e7c95f3-bd94-4c2f-89bb-48f4be7307f3 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286/ips" status: 200 len: 151 microversion: 2.20 time: 0.043827 Jul 28 18:16:30.901492 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 214/423] 10.222.0.86 () {60 vars in 1289 bytes} [Thu Jul 28 18:16:30 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286/ips => generated 151 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 18:16:34.403002 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-4c869b79-547b-458f-ad44-c988cb3d00cf tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:16:34.403620 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-4c869b79-547b-458f-ad44-c988cb3d00cf tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:16:34.405772 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=7 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:34.406419 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=19 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:34.411513 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4c869b79-547b-458f-ad44-c988cb3d00cf tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:34.412016 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4c869b79-547b-458f-ad44-c988cb3d00cf tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:34.412803 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4c869b79-547b-458f-ad44-c988cb3d00cf tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:34.413228 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4c869b79-547b-458f-ad44-c988cb3d00cf tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:34.441635 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.objects.instance [None req-4c869b79-547b-458f-ad44-c988cb3d00cf tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lazy-loading 'flavor' on Instance uuid 2b1c63c9-4f4b-4c9e-91da-42f88fd63286 {{(pid=118453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:16:35.047880 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-4c869b79-547b-458f-ad44-c988cb3d00cf tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "POST /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286/action" status: 202 len: 0 microversion: 2.20 time: 0.648892 Jul 28 18:16:35.048810 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 210/424] 10.222.0.86 () {62 vars in 1319 bytes} [Thu Jul 28 18:16:34 2022] POST /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286/action => generated 0 bytes in 651 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 28 18:16:35.057394 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-d9541fd5-9689-4e1b-902a-85d4e50dd121 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:16:35.058010 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-d9541fd5-9689-4e1b-902a-85d4e50dd121 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:16:35.070452 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d9541fd5-9689-4e1b-902a-85d4e50dd121 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:35.073944 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d9541fd5-9689-4e1b-902a-85d4e50dd121 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:35.075244 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d9541fd5-9689-4e1b-902a-85d4e50dd121 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:35.075933 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d9541fd5-9689-4e1b-902a-85d4e50dd121 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:35.320722 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-d9541fd5-9689-4e1b-902a-85d4e50dd121 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:35.333748 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-d9541fd5-9689-4e1b-902a-85d4e50dd121 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:35.335317 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-d9541fd5-9689-4e1b-902a-85d4e50dd121 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:35.336496 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-d9541fd5-9689-4e1b-902a-85d4e50dd121 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1721 microversion: 2.20 time: 0.283542 Jul 28 18:16:35.337104 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 215/425] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:16:35 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1721 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:16:36.360199 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5ed10616-fd4b-4d7a-a02f-c4b2cc6bf568 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:16:36.361670 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-5ed10616-fd4b-4d7a-a02f-c4b2cc6bf568 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:16:36.368865 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5ed10616-fd4b-4d7a-a02f-c4b2cc6bf568 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:36.369587 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5ed10616-fd4b-4d7a-a02f-c4b2cc6bf568 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:36.370548 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5ed10616-fd4b-4d7a-a02f-c4b2cc6bf568 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:36.371417 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5ed10616-fd4b-4d7a-a02f-c4b2cc6bf568 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:36.551004 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-5ed10616-fd4b-4d7a-a02f-c4b2cc6bf568 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:36.560340 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-5ed10616-fd4b-4d7a-a02f-c4b2cc6bf568 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:36.562393 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-5ed10616-fd4b-4d7a-a02f-c4b2cc6bf568 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:36.563508 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-5ed10616-fd4b-4d7a-a02f-c4b2cc6bf568 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1721 microversion: 2.20 time: 0.207618 Jul 28 18:16:36.564060 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 211/426] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:16:36 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1721 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:16:37.587319 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-464f4e82-cf16-4820-ba4c-9294b2a33634 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:16:37.587922 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-464f4e82-cf16-4820-ba4c-9294b2a33634 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:16:37.594746 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-464f4e82-cf16-4820-ba4c-9294b2a33634 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:37.597142 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-464f4e82-cf16-4820-ba4c-9294b2a33634 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:37.597142 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-464f4e82-cf16-4820-ba4c-9294b2a33634 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:37.597142 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-464f4e82-cf16-4820-ba4c-9294b2a33634 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:37.879096 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-464f4e82-cf16-4820-ba4c-9294b2a33634 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:37.888543 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-464f4e82-cf16-4820-ba4c-9294b2a33634 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:37.896181 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-464f4e82-cf16-4820-ba4c-9294b2a33634 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:37.896181 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-464f4e82-cf16-4820-ba4c-9294b2a33634 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1721 microversion: 2.20 time: 0.308033 Jul 28 18:16:37.896181 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 216/427] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:16:37 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1721 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:16:38.583434 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-7eefb68a-8fbc-446f-ac87-776cdb8be4fe tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:16:38.583925 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-7eefb68a-8fbc-446f-ac87-776cdb8be4fe tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:16:38.591613 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7eefb68a-8fbc-446f-ac87-776cdb8be4fe tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:38.596660 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7eefb68a-8fbc-446f-ac87-776cdb8be4fe tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:38.596660 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7eefb68a-8fbc-446f-ac87-776cdb8be4fe tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:38.596660 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7eefb68a-8fbc-446f-ac87-776cdb8be4fe tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:38.621425 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-7eefb68a-8fbc-446f-ac87-776cdb8be4fe tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd/ips" status: 200 len: 145 microversion: 2.1 time: 0.041891 Jul 28 18:16:38.622096 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 212/428] 10.222.0.86 () {58 vars in 1248 bytes} [Thu Jul 28 18:16:38 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd/ips => generated 145 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:16:38.916644 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-db438462-9da5-4cf5-b602-7b2f20f908df tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:16:38.918988 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-db438462-9da5-4cf5-b602-7b2f20f908df tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:16:38.926992 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-db438462-9da5-4cf5-b602-7b2f20f908df tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:38.927443 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-db438462-9da5-4cf5-b602-7b2f20f908df tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:38.928389 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-db438462-9da5-4cf5-b602-7b2f20f908df tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:38.929029 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-db438462-9da5-4cf5-b602-7b2f20f908df tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:39.111616 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-db438462-9da5-4cf5-b602-7b2f20f908df tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:39.122494 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-db438462-9da5-4cf5-b602-7b2f20f908df tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:39.124268 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-db438462-9da5-4cf5-b602-7b2f20f908df tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:39.125696 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-db438462-9da5-4cf5-b602-7b2f20f908df tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1721 microversion: 2.20 time: 0.213654 Jul 28 18:16:39.126253 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 217/429] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:16:38 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1721 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:16:39.954484 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-18a87a74-890d-4e18-8223-a8fe356e9093 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Action: 'create', calling method: .version_select at 0x7f6fe26ceca0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-554928045", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKiJmdnHzImFGRkGyEq1Y2Kq64Chz5GRCMhSn8ati23r1DCYK8JfKEUrw0Yf6T/4p7LQ6JqhHTsI5Qajwj1WsvTkRP2+meENNbYzuJv3igzx4U6fMIBlO7VZup9C2i9nMw=="}} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:16:39.970269 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.quota [None req-18a87a74-890d-4e18-8223-a8fe356e9093 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Getting quotas for project 308e6cf086ae4cdea9c591ed2811c976. Resources: {'key_pairs'} {{(pid=118453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 18:16:39.974693 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.quota [None req-18a87a74-890d-4e18-8223-a8fe356e9093 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Getting quotas for user 30f0002d2a5a4950b2f1aa771f33bbc1 and project 308e6cf086ae4cdea9c591ed2811c976. Resources: {'key_pairs'} {{(pid=118453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 18:16:39.987592 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR oslo.messaging._drivers.impl_rabbit [None req-18a87a74-890d-4e18-8223-a8fe356e9093 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [7a25c615-497b-41dc-91f1-137b33764f9e] AMQP server on 10.222.0.86:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 28 18:16:40.154026 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-122aacc7-edf1-47e2-8968-06a3aeba979b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:16:40.155192 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-122aacc7-edf1-47e2-8968-06a3aeba979b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:16:40.168518 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-122aacc7-edf1-47e2-8968-06a3aeba979b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:40.169187 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-122aacc7-edf1-47e2-8968-06a3aeba979b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:40.170194 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-122aacc7-edf1-47e2-8968-06a3aeba979b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:40.170866 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-122aacc7-edf1-47e2-8968-06a3aeba979b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:40.345794 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-122aacc7-edf1-47e2-8968-06a3aeba979b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:40.360356 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-122aacc7-edf1-47e2-8968-06a3aeba979b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:40.361936 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-122aacc7-edf1-47e2-8968-06a3aeba979b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:40.381128 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-122aacc7-edf1-47e2-8968-06a3aeba979b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1721 microversion: 2.20 time: 0.216133 Jul 28 18:16:40.381128 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 218/430] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:16:40 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1721 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:16:40.995519 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO oslo.messaging._drivers.impl_rabbit [None req-18a87a74-890d-4e18-8223-a8fe356e9093 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [7a25c615-497b-41dc-91f1-137b33764f9e] Reconnected to AMQP server on 10.222.0.86:5672 via [amqp] client with port 50306. Jul 28 18:16:41.091061 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-18a87a74-890d-4e18-8223-a8fe356e9093 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 1.332338 Jul 28 18:16:41.091975 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 213/431] 10.222.0.86 () {60 vars in 1159 bytes} [Thu Jul 28 18:16:39 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:16:41.391290 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-501d7fa9-4359-47aa-bc0f-f0992cabe677 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:16:41.392041 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-501d7fa9-4359-47aa-bc0f-f0992cabe677 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:16:41.398969 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-501d7fa9-4359-47aa-bc0f-f0992cabe677 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:41.399562 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-501d7fa9-4359-47aa-bc0f-f0992cabe677 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:41.401340 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-501d7fa9-4359-47aa-bc0f-f0992cabe677 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:41.401661 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-501d7fa9-4359-47aa-bc0f-f0992cabe677 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:41.537510 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-501d7fa9-4359-47aa-bc0f-f0992cabe677 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:41.548452 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-501d7fa9-4359-47aa-bc0f-f0992cabe677 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:41.550853 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-501d7fa9-4359-47aa-bc0f-f0992cabe677 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:41.552713 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-501d7fa9-4359-47aa-bc0f-f0992cabe677 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1721 microversion: 2.20 time: 0.165684 Jul 28 18:16:41.553430 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 219/432] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:16:41 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:16:42.582489 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-04664de4-8413-45c9-b770-efcf4dc6a157 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:16:42.583094 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-04664de4-8413-45c9-b770-efcf4dc6a157 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:16:42.590124 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-04664de4-8413-45c9-b770-efcf4dc6a157 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:42.590455 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-04664de4-8413-45c9-b770-efcf4dc6a157 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:42.591644 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-04664de4-8413-45c9-b770-efcf4dc6a157 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:42.592004 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-04664de4-8413-45c9-b770-efcf4dc6a157 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:42.741652 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-04664de4-8413-45c9-b770-efcf4dc6a157 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:42.750245 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-04664de4-8413-45c9-b770-efcf4dc6a157 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:42.758546 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-04664de4-8413-45c9-b770-efcf4dc6a157 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:42.759734 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-04664de4-8413-45c9-b770-efcf4dc6a157 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1721 microversion: 2.20 time: 0.181476 Jul 28 18:16:42.760351 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 214/433] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:16:42 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1721 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:16:42.787426 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-c168f979-f60b-4dd7-9c20-2e943e41a589 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7b69ec86-d4d5-4957-81ba-e67b04295ed5"}} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:16:42.789889 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-c168f979-f60b-4dd7-9c20-2e943e41a589 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:16:42.796655 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c168f979-f60b-4dd7-9c20-2e943e41a589 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:42.797245 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c168f979-f60b-4dd7-9c20-2e943e41a589 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:42.798076 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c168f979-f60b-4dd7-9c20-2e943e41a589 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:42.798582 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c168f979-f60b-4dd7-9c20-2e943e41a589 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:43.618678 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-c168f979-f60b-4dd7-9c20-2e943e41a589 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "POST /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.835665 Jul 28 18:16:43.619405 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 220/434] 10.222.0.86 () {60 vars in 1323 bytes} [Thu Jul 28 18:16:42 2022] POST /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd/os-volume_attachments => generated 194 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:16:43.785870 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b4f4f270-e4e7-41de-9482-c5a42989ee89 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:16:43.788729 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b4f4f270-e4e7-41de-9482-c5a42989ee89 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:16:43.794009 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b4f4f270-e4e7-41de-9482-c5a42989ee89 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:43.794453 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b4f4f270-e4e7-41de-9482-c5a42989ee89 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:43.795341 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b4f4f270-e4e7-41de-9482-c5a42989ee89 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:43.795777 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b4f4f270-e4e7-41de-9482-c5a42989ee89 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:43.957752 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b4f4f270-e4e7-41de-9482-c5a42989ee89 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:43.966912 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b4f4f270-e4e7-41de-9482-c5a42989ee89 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:43.968588 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b4f4f270-e4e7-41de-9482-c5a42989ee89 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:43.969885 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b4f4f270-e4e7-41de-9482-c5a42989ee89 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1721 microversion: 2.20 time: 0.188115 Jul 28 18:16:43.970438 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 215/435] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:16:43 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1721 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:16:44.998516 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-bdf64546-e14f-45ce-8142-ef01694d536a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:16:44.999228 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-bdf64546-e14f-45ce-8142-ef01694d536a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:16:45.007474 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-bdf64546-e14f-45ce-8142-ef01694d536a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:45.007938 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-bdf64546-e14f-45ce-8142-ef01694d536a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:45.008708 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-bdf64546-e14f-45ce-8142-ef01694d536a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:45.009222 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-bdf64546-e14f-45ce-8142-ef01694d536a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:45.219061 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-bdf64546-e14f-45ce-8142-ef01694d536a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:45.230868 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-bdf64546-e14f-45ce-8142-ef01694d536a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:45.235888 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-bdf64546-e14f-45ce-8142-ef01694d536a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:45.239048 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-bdf64546-e14f-45ce-8142-ef01694d536a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1721 microversion: 2.20 time: 0.248674 Jul 28 18:16:45.240589 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 221/436] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:16:44 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1721 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:16:46.263324 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-52c63d2c-2baf-4be6-a8cb-67a6f52af9b1 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:16:46.264003 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-52c63d2c-2baf-4be6-a8cb-67a6f52af9b1 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:16:46.271522 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-52c63d2c-2baf-4be6-a8cb-67a6f52af9b1 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:46.271827 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-52c63d2c-2baf-4be6-a8cb-67a6f52af9b1 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:46.272560 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-52c63d2c-2baf-4be6-a8cb-67a6f52af9b1 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:46.273055 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-52c63d2c-2baf-4be6-a8cb-67a6f52af9b1 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:46.417822 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-52c63d2c-2baf-4be6-a8cb-67a6f52af9b1 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:46.425739 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-52c63d2c-2baf-4be6-a8cb-67a6f52af9b1 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:46.427712 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-52c63d2c-2baf-4be6-a8cb-67a6f52af9b1 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:46.428876 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-52c63d2c-2baf-4be6-a8cb-67a6f52af9b1 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1721 microversion: 2.20 time: 0.169487 Jul 28 18:16:46.429495 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 216/437] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:16:46 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:16:47.453687 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-a308ff02-65e1-4d07-a15c-b9399164e22d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:16:47.454409 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-a308ff02-65e1-4d07-a15c-b9399164e22d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:16:47.461614 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a308ff02-65e1-4d07-a15c-b9399164e22d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:47.462065 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a308ff02-65e1-4d07-a15c-b9399164e22d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:47.462830 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a308ff02-65e1-4d07-a15c-b9399164e22d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:47.463271 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a308ff02-65e1-4d07-a15c-b9399164e22d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:47.594627 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-a308ff02-65e1-4d07-a15c-b9399164e22d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:47.602587 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-a308ff02-65e1-4d07-a15c-b9399164e22d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:47.604132 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-a308ff02-65e1-4d07-a15c-b9399164e22d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:47.605354 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-a308ff02-65e1-4d07-a15c-b9399164e22d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1721 microversion: 2.20 time: 0.155416 Jul 28 18:16:47.605898 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 222/438] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:16:47 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:16:48.629456 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f933a1c3-68cc-4afb-9898-579d815f35f5 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:16:48.630061 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f933a1c3-68cc-4afb-9898-579d815f35f5 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:16:48.636706 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f933a1c3-68cc-4afb-9898-579d815f35f5 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:48.637191 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f933a1c3-68cc-4afb-9898-579d815f35f5 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:48.637958 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f933a1c3-68cc-4afb-9898-579d815f35f5 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:48.638430 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f933a1c3-68cc-4afb-9898-579d815f35f5 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:48.765844 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f933a1c3-68cc-4afb-9898-579d815f35f5 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:48.773987 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f933a1c3-68cc-4afb-9898-579d815f35f5 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:48.775508 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f933a1c3-68cc-4afb-9898-579d815f35f5 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:48.776653 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f933a1c3-68cc-4afb-9898-579d815f35f5 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1721 microversion: 2.20 time: 0.151276 Jul 28 18:16:48.777239 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 217/439] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:16:48 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:16:49.799932 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-03aeed47-4231-47f0-84c0-3ce02437f277 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:16:49.800538 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-03aeed47-4231-47f0-84c0-3ce02437f277 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:16:49.808043 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-03aeed47-4231-47f0-84c0-3ce02437f277 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:49.808497 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-03aeed47-4231-47f0-84c0-3ce02437f277 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:49.809311 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-03aeed47-4231-47f0-84c0-3ce02437f277 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:49.809768 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-03aeed47-4231-47f0-84c0-3ce02437f277 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:49.939897 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-03aeed47-4231-47f0-84c0-3ce02437f277 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:49.947825 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-03aeed47-4231-47f0-84c0-3ce02437f277 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:49.949407 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-03aeed47-4231-47f0-84c0-3ce02437f277 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:49.950570 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-03aeed47-4231-47f0-84c0-3ce02437f277 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1721 microversion: 2.20 time: 0.154897 Jul 28 18:16:49.951150 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 223/440] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:16:49 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:16:50.974288 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-c196b0f1-12cf-40ca-8ad6-d0afb02a41f3 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:16:50.975265 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-c196b0f1-12cf-40ca-8ad6-d0afb02a41f3 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:16:50.977455 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell0:SELECT=4 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:50.983115 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c196b0f1-12cf-40ca-8ad6-d0afb02a41f3 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:50.983549 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c196b0f1-12cf-40ca-8ad6-d0afb02a41f3 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:50.987106 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c196b0f1-12cf-40ca-8ad6-d0afb02a41f3 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:50.987106 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c196b0f1-12cf-40ca-8ad6-d0afb02a41f3 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:51.119216 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-c196b0f1-12cf-40ca-8ad6-d0afb02a41f3 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:51.127363 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-c196b0f1-12cf-40ca-8ad6-d0afb02a41f3 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:51.128863 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-c196b0f1-12cf-40ca-8ad6-d0afb02a41f3 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:51.130042 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-c196b0f1-12cf-40ca-8ad6-d0afb02a41f3 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1721 microversion: 2.20 time: 0.160041 Jul 28 18:16:51.131119 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 218/441] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:16:50 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:16:52.159581 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-5b88c116-91b8-4b8e-8c14-79d19a5b7be5 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:16:52.160191 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-5b88c116-91b8-4b8e-8c14-79d19a5b7be5 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:16:52.167278 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-5b88c116-91b8-4b8e-8c14-79d19a5b7be5 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:52.167729 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-5b88c116-91b8-4b8e-8c14-79d19a5b7be5 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:52.168491 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-5b88c116-91b8-4b8e-8c14-79d19a5b7be5 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:52.168930 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-5b88c116-91b8-4b8e-8c14-79d19a5b7be5 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:52.297574 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-5b88c116-91b8-4b8e-8c14-79d19a5b7be5 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:52.306073 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-5b88c116-91b8-4b8e-8c14-79d19a5b7be5 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:52.307601 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-5b88c116-91b8-4b8e-8c14-79d19a5b7be5 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:52.308748 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-5b88c116-91b8-4b8e-8c14-79d19a5b7be5 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1721 microversion: 2.20 time: 0.153191 Jul 28 18:16:52.309341 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 224/442] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:16:52 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:16:52.488499 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-324117d1-b036-424b-b8e6-58e2ab392167 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:16:52.495546 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-324117d1-b036-424b-b8e6-58e2ab392167 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:52.495994 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-324117d1-b036-424b-b8e6-58e2ab392167 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:52.559506 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-324117d1-b036-424b-b8e6-58e2ab392167 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Going to try to stop instance {{(pid=118453) force_stop /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 18:16:52.687209 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-324117d1-b036-424b-b8e6-58e2ab392167 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "POST /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd/action" status: 202 len: 0 microversion: 2.1 time: 0.202225 Jul 28 18:16:52.687854 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 219/443] 10.222.0.86 () {60 vars in 1278 bytes} [Thu Jul 28 18:16:52 2022] POST /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 18:16:52.696202 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-b6f28b99-d1c7-4fd0-b2a1-e9acad7586ed tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:16:52.697280 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-b6f28b99-d1c7-4fd0-b2a1-e9acad7586ed tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:16:52.703168 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b6f28b99-d1c7-4fd0-b2a1-e9acad7586ed tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:52.703615 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b6f28b99-d1c7-4fd0-b2a1-e9acad7586ed tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:52.704692 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b6f28b99-d1c7-4fd0-b2a1-e9acad7586ed tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:52.705138 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b6f28b99-d1c7-4fd0-b2a1-e9acad7586ed tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:52.844931 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-b6f28b99-d1c7-4fd0-b2a1-e9acad7586ed tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:52.853778 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-b6f28b99-d1c7-4fd0-b2a1-e9acad7586ed tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1723 microversion: 2.1 time: 0.161423 Jul 28 18:16:52.854559 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 225/444] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:16:52 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:16:53.334719 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-6f93b6d5-39ef-493c-be0d-fd6d027db3a1 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:16:53.335331 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-6f93b6d5-39ef-493c-be0d-fd6d027db3a1 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:16:53.341903 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6f93b6d5-39ef-493c-be0d-fd6d027db3a1 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:53.342358 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6f93b6d5-39ef-493c-be0d-fd6d027db3a1 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:53.343125 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6f93b6d5-39ef-493c-be0d-fd6d027db3a1 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:53.343604 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6f93b6d5-39ef-493c-be0d-fd6d027db3a1 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:53.488649 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-6f93b6d5-39ef-493c-be0d-fd6d027db3a1 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:53.498244 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-6f93b6d5-39ef-493c-be0d-fd6d027db3a1 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:53.499749 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-6f93b6d5-39ef-493c-be0d-fd6d027db3a1 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:53.501138 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-6f93b6d5-39ef-493c-be0d-fd6d027db3a1 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1742 microversion: 2.20 time: 0.171458 Jul 28 18:16:53.505874 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 220/445] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:16:53 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1742 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:16:53.879000 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-43c71dd9-d503-43ae-bbc5-640c32ffd5ac tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:16:53.879616 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-43c71dd9-d503-43ae-bbc5-640c32ffd5ac tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:16:53.886526 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-43c71dd9-d503-43ae-bbc5-640c32ffd5ac tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:53.886972 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-43c71dd9-d503-43ae-bbc5-640c32ffd5ac tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:53.887940 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-43c71dd9-d503-43ae-bbc5-640c32ffd5ac tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:53.888374 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-43c71dd9-d503-43ae-bbc5-640c32ffd5ac tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:54.023615 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-43c71dd9-d503-43ae-bbc5-640c32ffd5ac tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:54.031786 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-43c71dd9-d503-43ae-bbc5-640c32ffd5ac tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1723 microversion: 2.1 time: 0.156775 Jul 28 18:16:54.032452 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 226/446] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:16:53 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:16:54.524642 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-6360333b-d0f5-41a8-a4c3-b44a2c0eb371 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:16:54.525174 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-6360333b-d0f5-41a8-a4c3-b44a2c0eb371 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:16:54.531496 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6360333b-d0f5-41a8-a4c3-b44a2c0eb371 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:54.531944 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6360333b-d0f5-41a8-a4c3-b44a2c0eb371 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:54.532716 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6360333b-d0f5-41a8-a4c3-b44a2c0eb371 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:54.533195 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6360333b-d0f5-41a8-a4c3-b44a2c0eb371 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:54.671981 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-6360333b-d0f5-41a8-a4c3-b44a2c0eb371 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:54.680829 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-6360333b-d0f5-41a8-a4c3-b44a2c0eb371 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:54.682370 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-6360333b-d0f5-41a8-a4c3-b44a2c0eb371 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:54.683752 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-6360333b-d0f5-41a8-a4c3-b44a2c0eb371 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1742 microversion: 2.20 time: 0.163109 Jul 28 18:16:54.684300 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 221/447] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:16:54 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1742 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:16:55.054395 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-f886d4b7-2a53-4142-89fd-14ed1d1bcb17 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:16:55.055223 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-f886d4b7-2a53-4142-89fd-14ed1d1bcb17 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:16:55.062354 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f886d4b7-2a53-4142-89fd-14ed1d1bcb17 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:55.062803 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f886d4b7-2a53-4142-89fd-14ed1d1bcb17 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:55.063773 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f886d4b7-2a53-4142-89fd-14ed1d1bcb17 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:55.064383 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f886d4b7-2a53-4142-89fd-14ed1d1bcb17 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:55.216507 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-f886d4b7-2a53-4142-89fd-14ed1d1bcb17 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:55.225735 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-f886d4b7-2a53-4142-89fd-14ed1d1bcb17 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1723 microversion: 2.1 time: 0.175840 Jul 28 18:16:55.226746 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 227/448] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:16:55 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:16:55.707611 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-e29cd811-e5c4-4e15-846c-887a67a638f7 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:16:55.708230 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-e29cd811-e5c4-4e15-846c-887a67a638f7 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:16:55.714779 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e29cd811-e5c4-4e15-846c-887a67a638f7 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:55.715232 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e29cd811-e5c4-4e15-846c-887a67a638f7 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:55.716056 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e29cd811-e5c4-4e15-846c-887a67a638f7 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:55.716814 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e29cd811-e5c4-4e15-846c-887a67a638f7 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:55.854487 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-e29cd811-e5c4-4e15-846c-887a67a638f7 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:55.862660 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-e29cd811-e5c4-4e15-846c-887a67a638f7 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:55.864184 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-e29cd811-e5c4-4e15-846c-887a67a638f7 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:55.865410 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-e29cd811-e5c4-4e15-846c-887a67a638f7 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1742 microversion: 2.20 time: 0.161634 Jul 28 18:16:55.865972 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 222/449] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:16:55 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1742 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:16:56.192699 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [req-2d232526-ed22-4315-a4c0-3b0fd40a8a7e req-c0f9b8e4-d911-4d73-9c73-92ac1c6e1f6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b1c63c9-4f4b-4c9e-91da-42f88fd63286", "name": "network-vif-plugged", "status": "completed", "tag": "1d258458-0cee-481c-93c4-bf0b858d9e28"}]} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:16:56.203218 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-2d232526-ed22-4315-a4c0-3b0fd40a8a7e req-c0f9b8e4-d911-4d73-9c73-92ac1c6e1f6c service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:56.203661 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-2d232526-ed22-4315-a4c0-3b0fd40a8a7e req-c0f9b8e4-d911-4d73-9c73-92ac1c6e1f6c service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:56.214471 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.compute.server_external_events [req-2d232526-ed22-4315-a4c0-3b0fd40a8a7e req-c0f9b8e4-d911-4d73-9c73-92ac1c6e1f6c service nova] Creating event network-vif-plugged:1d258458-0cee-481c-93c4-bf0b858d9e28 for instance 2b1c63c9-4f4b-4c9e-91da-42f88fd63286 on hv-cinder-84617 Jul 28 18:16:56.219811 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [req-2d232526-ed22-4315-a4c0-3b0fd40a8a7e req-c0f9b8e4-d911-4d73-9c73-92ac1c6e1f6c service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030866 Jul 28 18:16:56.220667 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 228/450] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:16:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:16:56.247517 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-cf425fc6-5ecb-4a03-8153-4c0f3d9c7ff5 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:16:56.248124 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-cf425fc6-5ecb-4a03-8153-4c0f3d9c7ff5 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:16:56.254136 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cf425fc6-5ecb-4a03-8153-4c0f3d9c7ff5 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:56.254586 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cf425fc6-5ecb-4a03-8153-4c0f3d9c7ff5 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:56.255416 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cf425fc6-5ecb-4a03-8153-4c0f3d9c7ff5 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:56.255846 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cf425fc6-5ecb-4a03-8153-4c0f3d9c7ff5 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:56.392049 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-cf425fc6-5ecb-4a03-8153-4c0f3d9c7ff5 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:56.401675 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-cf425fc6-5ecb-4a03-8153-4c0f3d9c7ff5 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1723 microversion: 2.1 time: 0.157917 Jul 28 18:16:56.402261 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 223/451] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:16:56 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:16:56.889644 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-6980f65c-d17c-42e6-a42f-b15ebbc4c2e7 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:16:56.890342 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-6980f65c-d17c-42e6-a42f-b15ebbc4c2e7 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:16:56.897060 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-6980f65c-d17c-42e6-a42f-b15ebbc4c2e7 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:56.897516 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-6980f65c-d17c-42e6-a42f-b15ebbc4c2e7 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:56.898313 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-6980f65c-d17c-42e6-a42f-b15ebbc4c2e7 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:56.898754 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-6980f65c-d17c-42e6-a42f-b15ebbc4c2e7 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:57.031403 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-6980f65c-d17c-42e6-a42f-b15ebbc4c2e7 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:57.039721 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-6980f65c-d17c-42e6-a42f-b15ebbc4c2e7 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:57.041266 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-6980f65c-d17c-42e6-a42f-b15ebbc4c2e7 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:57.042435 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-6980f65c-d17c-42e6-a42f-b15ebbc4c2e7 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1742 microversion: 2.20 time: 0.157127 Jul 28 18:16:57.042997 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 229/452] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:16:56 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1742 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:16:57.423661 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-1a7bf77e-2155-4580-bdf2-7af86246cb9a tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:16:57.424394 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-1a7bf77e-2155-4580-bdf2-7af86246cb9a tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:16:57.431155 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1a7bf77e-2155-4580-bdf2-7af86246cb9a tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:57.431597 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1a7bf77e-2155-4580-bdf2-7af86246cb9a tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:57.432359 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1a7bf77e-2155-4580-bdf2-7af86246cb9a tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:57.432794 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1a7bf77e-2155-4580-bdf2-7af86246cb9a tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:57.564761 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-1a7bf77e-2155-4580-bdf2-7af86246cb9a tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:57.568316 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:57.573165 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-1a7bf77e-2155-4580-bdf2-7af86246cb9a tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1723 microversion: 2.1 time: 0.153880 Jul 28 18:16:57.573720 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 224/453] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:16:57 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:16:58.067375 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-14774d02-2f18-466f-a95c-d848c60ceff9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:16:58.067375 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-14774d02-2f18-466f-a95c-d848c60ceff9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:16:58.073732 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-14774d02-2f18-466f-a95c-d848c60ceff9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:58.074188 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-14774d02-2f18-466f-a95c-d848c60ceff9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:58.074957 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-14774d02-2f18-466f-a95c-d848c60ceff9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:58.075376 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-14774d02-2f18-466f-a95c-d848c60ceff9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:58.079531 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:16:58.210109 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-14774d02-2f18-466f-a95c-d848c60ceff9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:58.218336 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-14774d02-2f18-466f-a95c-d848c60ceff9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:58.219951 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-14774d02-2f18-466f-a95c-d848c60ceff9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:58.221205 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-14774d02-2f18-466f-a95c-d848c60ceff9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1742 microversion: 2.20 time: 0.160060 Jul 28 18:16:58.221765 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 230/454] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:16:58 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1742 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:16:58.595011 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-28c80ae9-f81a-46be-a640-7e131f5a03bb tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:16:58.595632 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-28c80ae9-f81a-46be-a640-7e131f5a03bb tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:16:58.602066 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-28c80ae9-f81a-46be-a640-7e131f5a03bb tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:58.602519 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-28c80ae9-f81a-46be-a640-7e131f5a03bb tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:58.603279 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-28c80ae9-f81a-46be-a640-7e131f5a03bb tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:58.603716 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-28c80ae9-f81a-46be-a640-7e131f5a03bb tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:58.738515 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-28c80ae9-f81a-46be-a640-7e131f5a03bb tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:58.746840 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-28c80ae9-f81a-46be-a640-7e131f5a03bb tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1723 microversion: 2.1 time: 0.156247 Jul 28 18:16:58.747405 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 225/455] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:16:58 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:16:59.246609 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-31e06af6-9a2c-4f02-b6aa-068588d77477 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:16:59.247343 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-31e06af6-9a2c-4f02-b6aa-068588d77477 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:16:59.254290 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-31e06af6-9a2c-4f02-b6aa-068588d77477 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:59.254743 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-31e06af6-9a2c-4f02-b6aa-068588d77477 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:59.255507 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-31e06af6-9a2c-4f02-b6aa-068588d77477 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:59.255947 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-31e06af6-9a2c-4f02-b6aa-068588d77477 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:59.390124 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-31e06af6-9a2c-4f02-b6aa-068588d77477 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:59.398512 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-31e06af6-9a2c-4f02-b6aa-068588d77477 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:59.400029 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-31e06af6-9a2c-4f02-b6aa-068588d77477 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:59.401216 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-31e06af6-9a2c-4f02-b6aa-068588d77477 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1742 microversion: 2.20 time: 0.158619 Jul 28 18:16:59.401782 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 231/456] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:16:59 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1742 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:16:59.769145 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-9c854798-7d58-47dd-ac15-ab02a410578f tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:16:59.769913 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-9c854798-7d58-47dd-ac15-ab02a410578f tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:16:59.776543 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9c854798-7d58-47dd-ac15-ab02a410578f tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:59.777322 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9c854798-7d58-47dd-ac15-ab02a410578f tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:59.778489 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9c854798-7d58-47dd-ac15-ab02a410578f tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:16:59.779149 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9c854798-7d58-47dd-ac15-ab02a410578f tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:16:59.928045 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-9c854798-7d58-47dd-ac15-ab02a410578f tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:16:59.935995 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-9c854798-7d58-47dd-ac15-ab02a410578f tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1723 microversion: 2.1 time: 0.170738 Jul 28 18:16:59.936658 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 226/457] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:16:59 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:17:00.426301 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-d2ffbee5-4f90-4b22-bced-8ac91d85ce11 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:00.428231 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-d2ffbee5-4f90-4b22-bced-8ac91d85ce11 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:00.440040 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d2ffbee5-4f90-4b22-bced-8ac91d85ce11 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:00.440785 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d2ffbee5-4f90-4b22-bced-8ac91d85ce11 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:00.441977 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d2ffbee5-4f90-4b22-bced-8ac91d85ce11 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:00.442751 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d2ffbee5-4f90-4b22-bced-8ac91d85ce11 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:00.602480 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-d2ffbee5-4f90-4b22-bced-8ac91d85ce11 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:00.610835 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-d2ffbee5-4f90-4b22-bced-8ac91d85ce11 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:00.612524 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-d2ffbee5-4f90-4b22-bced-8ac91d85ce11 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:00.613716 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-d2ffbee5-4f90-4b22-bced-8ac91d85ce11 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1742 microversion: 2.20 time: 0.191869 Jul 28 18:17:00.614272 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 232/458] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:17:00 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1742 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:17:00.957504 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-cde42ba9-b324-4038-b041-698fbf7ae536 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:00.958279 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-cde42ba9-b324-4038-b041-698fbf7ae536 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:00.965386 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cde42ba9-b324-4038-b041-698fbf7ae536 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:00.965835 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cde42ba9-b324-4038-b041-698fbf7ae536 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:00.966862 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cde42ba9-b324-4038-b041-698fbf7ae536 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:00.967383 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cde42ba9-b324-4038-b041-698fbf7ae536 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:01.396068 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-cde42ba9-b324-4038-b041-698fbf7ae536 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:01.404395 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-cde42ba9-b324-4038-b041-698fbf7ae536 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1723 microversion: 2.1 time: 0.450674 Jul 28 18:17:01.404956 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 227/459] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:17:00 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1723 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:17:01.636374 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-c85f68ef-291a-4f18-ad1a-d0dbeca33544 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:01.636913 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-c85f68ef-291a-4f18-ad1a-d0dbeca33544 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:01.643355 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c85f68ef-291a-4f18-ad1a-d0dbeca33544 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:01.643807 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c85f68ef-291a-4f18-ad1a-d0dbeca33544 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:01.644573 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c85f68ef-291a-4f18-ad1a-d0dbeca33544 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:01.645099 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c85f68ef-291a-4f18-ad1a-d0dbeca33544 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:01.790302 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-c85f68ef-291a-4f18-ad1a-d0dbeca33544 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:01.799117 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-c85f68ef-291a-4f18-ad1a-d0dbeca33544 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:01.800635 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-c85f68ef-291a-4f18-ad1a-d0dbeca33544 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:01.801823 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-c85f68ef-291a-4f18-ad1a-d0dbeca33544 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1742 microversion: 2.20 time: 0.169453 Jul 28 18:17:01.802378 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 233/460] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:17:01 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1742 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:17:02.428610 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3959b18d-786f-4706-a976-23d03a85ce40 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:02.429343 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3959b18d-786f-4706-a976-23d03a85ce40 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:02.435393 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3959b18d-786f-4706-a976-23d03a85ce40 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:02.435918 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3959b18d-786f-4706-a976-23d03a85ce40 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:02.436754 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3959b18d-786f-4706-a976-23d03a85ce40 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:02.437305 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3959b18d-786f-4706-a976-23d03a85ce40 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:02.572239 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-3959b18d-786f-4706-a976-23d03a85ce40 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:02.580607 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-3959b18d-786f-4706-a976-23d03a85ce40 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1723 microversion: 2.1 time: 0.156572 Jul 28 18:17:02.581208 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 228/461] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:17:02 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:17:02.825832 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-7c922a5b-ca9d-421e-90f8-f348a2e34c37 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:02.826595 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-7c922a5b-ca9d-421e-90f8-f348a2e34c37 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:02.833259 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-7c922a5b-ca9d-421e-90f8-f348a2e34c37 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:02.834211 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-7c922a5b-ca9d-421e-90f8-f348a2e34c37 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:02.835342 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-7c922a5b-ca9d-421e-90f8-f348a2e34c37 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:02.835758 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-7c922a5b-ca9d-421e-90f8-f348a2e34c37 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:02.986888 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-7c922a5b-ca9d-421e-90f8-f348a2e34c37 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:02.995735 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-7c922a5b-ca9d-421e-90f8-f348a2e34c37 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:02.997509 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-7c922a5b-ca9d-421e-90f8-f348a2e34c37 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:02.998736 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-7c922a5b-ca9d-421e-90f8-f348a2e34c37 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1742 microversion: 2.20 time: 0.176891 Jul 28 18:17:02.999286 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 234/462] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:17:02 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1742 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:17:03.605942 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d1142049-b15d-4ed4-8efc-0e6466709833 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:03.606549 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-d1142049-b15d-4ed4-8efc-0e6466709833 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:03.612853 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d1142049-b15d-4ed4-8efc-0e6466709833 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:03.613363 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d1142049-b15d-4ed4-8efc-0e6466709833 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:03.614275 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d1142049-b15d-4ed4-8efc-0e6466709833 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:03.614807 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d1142049-b15d-4ed4-8efc-0e6466709833 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:03.752591 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-d1142049-b15d-4ed4-8efc-0e6466709833 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:03.761465 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-d1142049-b15d-4ed4-8efc-0e6466709833 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1723 microversion: 2.1 time: 0.159644 Jul 28 18:17:03.762234 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 229/463] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:17:03 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:17:04.022340 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-ca68b021-d212-4538-aaf1-3ba5ac94a908 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:04.022966 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-ca68b021-d212-4538-aaf1-3ba5ac94a908 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:04.029564 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ca68b021-d212-4538-aaf1-3ba5ac94a908 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:04.030005 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ca68b021-d212-4538-aaf1-3ba5ac94a908 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:04.030927 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ca68b021-d212-4538-aaf1-3ba5ac94a908 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:04.031394 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ca68b021-d212-4538-aaf1-3ba5ac94a908 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:04.230953 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-ca68b021-d212-4538-aaf1-3ba5ac94a908 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:04.243884 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-ca68b021-d212-4538-aaf1-3ba5ac94a908 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:04.246039 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-ca68b021-d212-4538-aaf1-3ba5ac94a908 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:04.247639 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-ca68b021-d212-4538-aaf1-3ba5ac94a908 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1737 microversion: 2.20 time: 0.229752 Jul 28 18:17:04.248743 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 235/464] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:17:04 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1737 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:17:04.784284 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f1215f93-cd74-4512-ac12-d47c2fa7fb34 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:04.784893 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f1215f93-cd74-4512-ac12-d47c2fa7fb34 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:04.794360 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=1 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:17:04.796425 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f1215f93-cd74-4512-ac12-d47c2fa7fb34 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:04.796937 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f1215f93-cd74-4512-ac12-d47c2fa7fb34 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:04.797855 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f1215f93-cd74-4512-ac12-d47c2fa7fb34 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:04.798186 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f1215f93-cd74-4512-ac12-d47c2fa7fb34 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:04.973732 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f1215f93-cd74-4512-ac12-d47c2fa7fb34 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:04.983062 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f1215f93-cd74-4512-ac12-d47c2fa7fb34 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1723 microversion: 2.1 time: 0.203122 Jul 28 18:17:05.007440 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 230/465] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:17:04 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:17:05.274810 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-475f1f3b-f4ed-4871-9e94-85cb9310f37d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:05.275429 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-475f1f3b-f4ed-4871-9e94-85cb9310f37d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:05.278083 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_api:SELECT=45 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:17:05.285780 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-475f1f3b-f4ed-4871-9e94-85cb9310f37d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:05.286437 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-475f1f3b-f4ed-4871-9e94-85cb9310f37d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:05.287948 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-475f1f3b-f4ed-4871-9e94-85cb9310f37d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:05.288557 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-475f1f3b-f4ed-4871-9e94-85cb9310f37d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:05.535034 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-475f1f3b-f4ed-4871-9e94-85cb9310f37d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:05.546798 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-475f1f3b-f4ed-4871-9e94-85cb9310f37d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:05.552060 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-475f1f3b-f4ed-4871-9e94-85cb9310f37d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:05.554477 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-475f1f3b-f4ed-4871-9e94-85cb9310f37d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1737 microversion: 2.20 time: 0.283605 Jul 28 18:17:05.556160 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 236/466] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:17:05 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1737 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:17:06.014771 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-7233a8cc-a5b3-4e73-b3d6-36a21401bc23 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:06.015570 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-7233a8cc-a5b3-4e73-b3d6-36a21401bc23 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:06.029837 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7233a8cc-a5b3-4e73-b3d6-36a21401bc23 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:06.030285 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7233a8cc-a5b3-4e73-b3d6-36a21401bc23 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:06.032680 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7233a8cc-a5b3-4e73-b3d6-36a21401bc23 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:06.033626 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7233a8cc-a5b3-4e73-b3d6-36a21401bc23 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:06.209881 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-7233a8cc-a5b3-4e73-b3d6-36a21401bc23 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:06.222587 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-7233a8cc-a5b3-4e73-b3d6-36a21401bc23 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1723 microversion: 2.1 time: 0.212395 Jul 28 18:17:06.273760 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 231/467] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:17:06 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1723 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:17:06.582682 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-e8da67d7-ab47-4c40-906b-289a7ac93e53 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:06.583422 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-e8da67d7-ab47-4c40-906b-289a7ac93e53 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:06.608428 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e8da67d7-ab47-4c40-906b-289a7ac93e53 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:06.613746 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e8da67d7-ab47-4c40-906b-289a7ac93e53 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:06.613746 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e8da67d7-ab47-4c40-906b-289a7ac93e53 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:06.613746 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e8da67d7-ab47-4c40-906b-289a7ac93e53 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:06.847009 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-e8da67d7-ab47-4c40-906b-289a7ac93e53 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:06.858042 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-e8da67d7-ab47-4c40-906b-289a7ac93e53 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:06.859851 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-e8da67d7-ab47-4c40-906b-289a7ac93e53 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:06.861185 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-e8da67d7-ab47-4c40-906b-289a7ac93e53 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1737 microversion: 2.20 time: 0.282678 Jul 28 18:17:06.871573 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 237/468] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:17:06 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1737 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:17:07.294894 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-acd6979d-4141-4eeb-a868-70346bfeee8d tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:07.295507 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-acd6979d-4141-4eeb-a868-70346bfeee8d tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:07.307076 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-acd6979d-4141-4eeb-a868-70346bfeee8d tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:07.307586 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-acd6979d-4141-4eeb-a868-70346bfeee8d tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:07.308363 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-acd6979d-4141-4eeb-a868-70346bfeee8d tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:07.308808 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-acd6979d-4141-4eeb-a868-70346bfeee8d tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:07.500429 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-acd6979d-4141-4eeb-a868-70346bfeee8d tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:07.514976 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-acd6979d-4141-4eeb-a868-70346bfeee8d tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1723 microversion: 2.1 time: 0.222926 Jul 28 18:17:07.530393 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 232/469] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:17:07 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1723 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:17:07.912364 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-80939d00-6d40-44ed-9c64-f32d669360c2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:07.912364 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-80939d00-6d40-44ed-9c64-f32d669360c2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:07.912364 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-80939d00-6d40-44ed-9c64-f32d669360c2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:07.912364 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-80939d00-6d40-44ed-9c64-f32d669360c2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:07.913536 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-80939d00-6d40-44ed-9c64-f32d669360c2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:07.913536 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-80939d00-6d40-44ed-9c64-f32d669360c2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:08.113949 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-80939d00-6d40-44ed-9c64-f32d669360c2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:08.122652 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-80939d00-6d40-44ed-9c64-f32d669360c2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:08.124166 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-80939d00-6d40-44ed-9c64-f32d669360c2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:08.125373 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-80939d00-6d40-44ed-9c64-f32d669360c2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1737 microversion: 2.20 time: 0.245567 Jul 28 18:17:08.125960 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 238/470] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:17:07 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1737 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:17:08.537757 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-fefaefba-8138-4f28-9a44-c77984970b2c tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:08.539033 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-fefaefba-8138-4f28-9a44-c77984970b2c tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:08.545312 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fefaefba-8138-4f28-9a44-c77984970b2c tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:08.548466 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fefaefba-8138-4f28-9a44-c77984970b2c tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:08.548466 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fefaefba-8138-4f28-9a44-c77984970b2c tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:08.548466 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fefaefba-8138-4f28-9a44-c77984970b2c tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:08.826604 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-fefaefba-8138-4f28-9a44-c77984970b2c tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:08.847272 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-fefaefba-8138-4f28-9a44-c77984970b2c tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1723 microversion: 2.1 time: 0.313799 Jul 28 18:17:08.865605 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 233/471] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:17:08 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1723 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:17:09.150194 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-e2f72fea-f9e2-4aa6-92e5-d67550722ce0 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:09.151424 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-e2f72fea-f9e2-4aa6-92e5-d67550722ce0 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:09.160680 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e2f72fea-f9e2-4aa6-92e5-d67550722ce0 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:09.167067 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e2f72fea-f9e2-4aa6-92e5-d67550722ce0 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:09.168177 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e2f72fea-f9e2-4aa6-92e5-d67550722ce0 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:09.171246 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e2f72fea-f9e2-4aa6-92e5-d67550722ce0 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:09.546297 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-e2f72fea-f9e2-4aa6-92e5-d67550722ce0 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:09.559466 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-e2f72fea-f9e2-4aa6-92e5-d67550722ce0 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:09.562060 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-e2f72fea-f9e2-4aa6-92e5-d67550722ce0 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:09.563503 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-e2f72fea-f9e2-4aa6-92e5-d67550722ce0 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1737 microversion: 2.20 time: 0.417328 Jul 28 18:17:09.564754 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 239/472] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:17:09 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1737 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:17:09.872477 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-340b4ddc-2c03-4d51-ae49-296d7e7c54c6 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:09.873844 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-340b4ddc-2c03-4d51-ae49-296d7e7c54c6 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:09.882949 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-340b4ddc-2c03-4d51-ae49-296d7e7c54c6 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:09.883786 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-340b4ddc-2c03-4d51-ae49-296d7e7c54c6 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:09.885211 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-340b4ddc-2c03-4d51-ae49-296d7e7c54c6 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:09.886076 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-340b4ddc-2c03-4d51-ae49-296d7e7c54c6 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:10.101446 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-340b4ddc-2c03-4d51-ae49-296d7e7c54c6 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:10.112315 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-340b4ddc-2c03-4d51-ae49-296d7e7c54c6 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1700 microversion: 2.1 time: 0.243948 Jul 28 18:17:10.113911 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 234/473] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:17:09 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1700 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:17:10.137556 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-01d5c662-fb8b-4cae-b444-72964eed08bc tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:17:10.146371 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-01d5c662-fb8b-4cae-b444-72964eed08bc tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:10.147086 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-01d5c662-fb8b-4cae-b444-72964eed08bc tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:10.227569 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-01d5c662-fb8b-4cae-b444-72964eed08bc tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Going to try to start instance {{(pid=118454) start /opt/stack/nova/nova/compute/api.py:2733}} Jul 28 18:17:10.470886 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-01d5c662-fb8b-4cae-b444-72964eed08bc tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "POST /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd/action" status: 202 len: 0 microversion: 2.1 time: 0.338267 Jul 28 18:17:10.477365 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 240/474] 10.222.0.86 () {60 vars in 1278 bytes} [Thu Jul 28 18:17:10 2022] POST /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd/action => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 18:17:10.485068 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-6c3b43be-38d5-499a-a748-213e48dd8422 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:10.485890 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-6c3b43be-38d5-499a-a748-213e48dd8422 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:10.493672 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6c3b43be-38d5-499a-a748-213e48dd8422 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:10.496557 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6c3b43be-38d5-499a-a748-213e48dd8422 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:10.501516 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6c3b43be-38d5-499a-a748-213e48dd8422 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:10.502314 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6c3b43be-38d5-499a-a748-213e48dd8422 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:10.589529 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-2f6410d5-ccf5-4a25-95c2-062d18953496 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:10.590754 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-2f6410d5-ccf5-4a25-95c2-062d18953496 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:10.616768 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2f6410d5-ccf5-4a25-95c2-062d18953496 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:10.617364 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2f6410d5-ccf5-4a25-95c2-062d18953496 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:10.626404 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2f6410d5-ccf5-4a25-95c2-062d18953496 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:10.629636 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2f6410d5-ccf5-4a25-95c2-062d18953496 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:10.711796 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-6c3b43be-38d5-499a-a748-213e48dd8422 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:10.715108 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-6c3b43be-38d5-499a-a748-213e48dd8422 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1709 microversion: 2.1 time: 0.236286 Jul 28 18:17:10.716557 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 235/475] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:17:10 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1709 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:17:10.951451 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-2f6410d5-ccf5-4a25-95c2-062d18953496 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:10.960216 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-2f6410d5-ccf5-4a25-95c2-062d18953496 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:10.961777 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-2f6410d5-ccf5-4a25-95c2-062d18953496 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:10.962954 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-2f6410d5-ccf5-4a25-95c2-062d18953496 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1737 microversion: 2.20 time: 0.379327 Jul 28 18:17:10.963509 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 241/476] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:17:10 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1737 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:17:11.738941 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-9f4567ea-d274-4e8e-8610-a7092720a4ab tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:11.739529 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-9f4567ea-d274-4e8e-8610-a7092720a4ab tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:11.749252 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9f4567ea-d274-4e8e-8610-a7092720a4ab tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:11.753829 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9f4567ea-d274-4e8e-8610-a7092720a4ab tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:11.757037 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9f4567ea-d274-4e8e-8610-a7092720a4ab tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:11.760583 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9f4567ea-d274-4e8e-8610-a7092720a4ab tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:11.991422 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-023096d7-009a-4d55-a385-8e701e5f1255 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:11.992098 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-023096d7-009a-4d55-a385-8e701e5f1255 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:11.994600 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-9f4567ea-d274-4e8e-8610-a7092720a4ab tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:12.007009 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-9f4567ea-d274-4e8e-8610-a7092720a4ab tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1709 microversion: 2.1 time: 0.272196 Jul 28 18:17:12.007642 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 236/477] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:17:11 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1709 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:17:12.017277 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-023096d7-009a-4d55-a385-8e701e5f1255 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:12.017277 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-023096d7-009a-4d55-a385-8e701e5f1255 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:12.017277 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-023096d7-009a-4d55-a385-8e701e5f1255 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:12.017277 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-023096d7-009a-4d55-a385-8e701e5f1255 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:12.257952 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-023096d7-009a-4d55-a385-8e701e5f1255 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:12.266862 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-023096d7-009a-4d55-a385-8e701e5f1255 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:12.268668 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-023096d7-009a-4d55-a385-8e701e5f1255 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:12.270066 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-023096d7-009a-4d55-a385-8e701e5f1255 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1737 microversion: 2.20 time: 0.283647 Jul 28 18:17:12.281053 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 242/478] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:17:11 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1737 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:17:13.039137 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-8872bb44-8944-4b57-816f-65cec86fdd5f tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:13.042161 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-8872bb44-8944-4b57-816f-65cec86fdd5f tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:13.056322 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8872bb44-8944-4b57-816f-65cec86fdd5f tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:13.056839 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8872bb44-8944-4b57-816f-65cec86fdd5f tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:13.057776 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8872bb44-8944-4b57-816f-65cec86fdd5f tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:13.058228 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8872bb44-8944-4b57-816f-65cec86fdd5f tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:13.292958 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-52ae5053-9f07-43dd-bef3-d73266b232fa tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:13.293798 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-52ae5053-9f07-43dd-bef3-d73266b232fa tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:13.321689 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-52ae5053-9f07-43dd-bef3-d73266b232fa tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:13.322150 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-52ae5053-9f07-43dd-bef3-d73266b232fa tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:13.323099 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-52ae5053-9f07-43dd-bef3-d73266b232fa tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:13.323454 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-52ae5053-9f07-43dd-bef3-d73266b232fa tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:13.431687 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8872bb44-8944-4b57-816f-65cec86fdd5f tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:13.449804 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-8872bb44-8944-4b57-816f-65cec86fdd5f tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1713 microversion: 2.1 time: 0.422426 Jul 28 18:17:13.452025 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 237/479] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:17:13 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1713 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:17:13.508614 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-52ae5053-9f07-43dd-bef3-d73266b232fa tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:13.523177 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-52ae5053-9f07-43dd-bef3-d73266b232fa tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:13.525637 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-52ae5053-9f07-43dd-bef3-d73266b232fa tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:13.528695 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-52ae5053-9f07-43dd-bef3-d73266b232fa tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1737 microversion: 2.20 time: 0.239470 Jul 28 18:17:13.529864 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 243/480] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:17:13 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1737 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:17:14.560389 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f0f58b0d-fa31-4bee-9f7a-e6752ff7f20f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:14.561699 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f0f58b0d-fa31-4bee-9f7a-e6752ff7f20f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:14.573638 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f0f58b0d-fa31-4bee-9f7a-e6752ff7f20f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:14.575239 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f0f58b0d-fa31-4bee-9f7a-e6752ff7f20f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:14.576487 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f0f58b0d-fa31-4bee-9f7a-e6752ff7f20f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:14.577233 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f0f58b0d-fa31-4bee-9f7a-e6752ff7f20f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:14.809058 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f0f58b0d-fa31-4bee-9f7a-e6752ff7f20f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:14.819242 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f0f58b0d-fa31-4bee-9f7a-e6752ff7f20f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:14.820930 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f0f58b0d-fa31-4bee-9f7a-e6752ff7f20f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:14.822128 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f0f58b0d-fa31-4bee-9f7a-e6752ff7f20f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1737 microversion: 2.20 time: 0.267693 Jul 28 18:17:14.822686 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 238/481] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:17:14 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1737 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:17:15.847413 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-2f3679a6-8b7f-4f56-8bd8-aa3c536f8db6 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:15.850142 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-2f3679a6-8b7f-4f56-8bd8-aa3c536f8db6 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:15.865740 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2f3679a6-8b7f-4f56-8bd8-aa3c536f8db6 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:15.866605 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2f3679a6-8b7f-4f56-8bd8-aa3c536f8db6 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:15.867656 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2f3679a6-8b7f-4f56-8bd8-aa3c536f8db6 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:15.868203 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2f3679a6-8b7f-4f56-8bd8-aa3c536f8db6 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:16.091519 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-2f3679a6-8b7f-4f56-8bd8-aa3c536f8db6 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:16.101359 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-2f3679a6-8b7f-4f56-8bd8-aa3c536f8db6 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:16.103274 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-2f3679a6-8b7f-4f56-8bd8-aa3c536f8db6 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:16.117202 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-2f3679a6-8b7f-4f56-8bd8-aa3c536f8db6 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1737 microversion: 2.20 time: 0.261490 Jul 28 18:17:16.117202 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 244/482] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:17:15 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1737 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:17:17.133494 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-743d471d-5777-4340-afe8-f445297691c8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:17.134930 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-743d471d-5777-4340-afe8-f445297691c8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:17.145721 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-743d471d-5777-4340-afe8-f445297691c8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:17.147005 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-743d471d-5777-4340-afe8-f445297691c8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:17.149185 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-743d471d-5777-4340-afe8-f445297691c8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:17.151232 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-743d471d-5777-4340-afe8-f445297691c8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:17.425380 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-743d471d-5777-4340-afe8-f445297691c8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:17.442385 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-743d471d-5777-4340-afe8-f445297691c8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:17.444469 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-743d471d-5777-4340-afe8-f445297691c8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:17.445927 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-743d471d-5777-4340-afe8-f445297691c8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1737 microversion: 2.20 time: 0.317584 Jul 28 18:17:17.447220 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 239/483] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:17:17 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1737 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:17:18.480906 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-ee5d1d4a-6c34-455a-b266-d33b65cabfde tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:18.483091 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-ee5d1d4a-6c34-455a-b266-d33b65cabfde tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:18.515467 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ee5d1d4a-6c34-455a-b266-d33b65cabfde tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:18.516767 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ee5d1d4a-6c34-455a-b266-d33b65cabfde tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:18.518778 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ee5d1d4a-6c34-455a-b266-d33b65cabfde tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:18.523705 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ee5d1d4a-6c34-455a-b266-d33b65cabfde tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:18.738180 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-ee5d1d4a-6c34-455a-b266-d33b65cabfde tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:18.742459 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:17:18.755313 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-ee5d1d4a-6c34-455a-b266-d33b65cabfde tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:18.760351 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-ee5d1d4a-6c34-455a-b266-d33b65cabfde tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:18.763133 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-ee5d1d4a-6c34-455a-b266-d33b65cabfde tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1737 microversion: 2.20 time: 0.297761 Jul 28 18:17:18.765760 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 245/484] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:17:18 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1737 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:17:19.132387 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-78d1e162-9560-4ca6-8043-8ced0b8d302b tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Action: 'create', calling method: .version_select at 0x7f6fe25fb550>, body: {"keypair": {"name": "tempest-TestShelveInstance-182682276", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE4Sbm9SMY1GtwRHnrfb54ZFaM16mDW0PfZ1DfO2XM0056eOpP7/2crsRt8FENyfBO4Gd7El6OI4MeGoQQ8ChL5G9ym0TWsJ3pueB3PqYi4nzJREeuxwB1Rh912/r7f6tA=="}} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:17:19.150962 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.quota [None req-78d1e162-9560-4ca6-8043-8ced0b8d302b tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Getting quotas for project bf347b1959b247bcbe003ac3662cb239. Resources: {'key_pairs'} {{(pid=118453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 18:17:19.154883 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.quota [None req-78d1e162-9560-4ca6-8043-8ced0b8d302b tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Getting quotas for user 83ba025a383c433b900a3f4ae64959b3 and project bf347b1959b247bcbe003ac3662cb239. Resources: {'key_pairs'} {{(pid=118453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 18:17:19.318287 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-78d1e162-9560-4ca6-8043-8ced0b8d302b tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.408457 Jul 28 18:17:19.318945 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 240/485] 10.222.0.86 () {60 vars in 1159 bytes} [Thu Jul 28 18:17:18 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 18:17:19.790533 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-245902dd-2342-4cce-9c4e-f11dbb7bd315 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:19.791712 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-245902dd-2342-4cce-9c4e-f11dbb7bd315 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:19.800913 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-245902dd-2342-4cce-9c4e-f11dbb7bd315 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:19.801419 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-245902dd-2342-4cce-9c4e-f11dbb7bd315 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:19.802761 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-245902dd-2342-4cce-9c4e-f11dbb7bd315 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:19.803207 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-245902dd-2342-4cce-9c4e-f11dbb7bd315 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:20.002682 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-245902dd-2342-4cce-9c4e-f11dbb7bd315 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:20.011468 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-245902dd-2342-4cce-9c4e-f11dbb7bd315 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:20.013072 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-245902dd-2342-4cce-9c4e-f11dbb7bd315 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:20.014188 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-245902dd-2342-4cce-9c4e-f11dbb7bd315 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1737 microversion: 2.20 time: 0.228187 Jul 28 18:17:20.016339 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 246/486] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:17:19 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1737 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:17:21.038695 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-9d9bfbc3-9652-4c44-8c47-3f206eed3900 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:21.039267 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-9d9bfbc3-9652-4c44-8c47-3f206eed3900 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:21.046334 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9d9bfbc3-9652-4c44-8c47-3f206eed3900 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:21.046998 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9d9bfbc3-9652-4c44-8c47-3f206eed3900 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:21.048137 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9d9bfbc3-9652-4c44-8c47-3f206eed3900 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:21.048584 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9d9bfbc3-9652-4c44-8c47-3f206eed3900 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:21.214937 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-9d9bfbc3-9652-4c44-8c47-3f206eed3900 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:21.224075 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-9d9bfbc3-9652-4c44-8c47-3f206eed3900 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:21.225913 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-9d9bfbc3-9652-4c44-8c47-3f206eed3900 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:21.227121 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-9d9bfbc3-9652-4c44-8c47-3f206eed3900 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1737 microversion: 2.20 time: 0.192585 Jul 28 18:17:21.227675 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 241/487] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:17:21 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1737 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:17:22.249360 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-070aa8f2-a230-4e63-9b89-be9d172e2b8e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:22.249958 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-070aa8f2-a230-4e63-9b89-be9d172e2b8e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:22.256678 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-070aa8f2-a230-4e63-9b89-be9d172e2b8e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:22.257334 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-070aa8f2-a230-4e63-9b89-be9d172e2b8e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:22.258248 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-070aa8f2-a230-4e63-9b89-be9d172e2b8e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:22.258651 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-070aa8f2-a230-4e63-9b89-be9d172e2b8e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:22.395789 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-070aa8f2-a230-4e63-9b89-be9d172e2b8e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:22.404481 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-070aa8f2-a230-4e63-9b89-be9d172e2b8e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:22.417196 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-070aa8f2-a230-4e63-9b89-be9d172e2b8e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:22.417196 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-070aa8f2-a230-4e63-9b89-be9d172e2b8e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1737 microversion: 2.20 time: 0.161972 Jul 28 18:17:22.417196 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 247/488] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:17:22 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:17:23.435108 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-1595e3aa-fe75-43a9-8554-d3b143017c6b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:23.435843 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-1595e3aa-fe75-43a9-8554-d3b143017c6b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:23.445052 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1595e3aa-fe75-43a9-8554-d3b143017c6b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:23.445512 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1595e3aa-fe75-43a9-8554-d3b143017c6b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:23.446309 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1595e3aa-fe75-43a9-8554-d3b143017c6b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:23.446803 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1595e3aa-fe75-43a9-8554-d3b143017c6b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:23.468699 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:17:23.594002 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-1595e3aa-fe75-43a9-8554-d3b143017c6b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:23.614850 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-1595e3aa-fe75-43a9-8554-d3b143017c6b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:23.614850 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-1595e3aa-fe75-43a9-8554-d3b143017c6b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:23.614850 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-1595e3aa-fe75-43a9-8554-d3b143017c6b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1719 microversion: 2.20 time: 0.181643 Jul 28 18:17:23.766963 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 242/489] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:17:23 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1719 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:17:23.845094 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-b8801977-72d0-4b54-997b-d017d8fe5f61 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-636082693", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-554928045", "security_groups": [{"name": "tempest-secgroup-smoke-370419790"}], "block_device_mapping_v2": [{"uuid": "ff03e33d-d90d-4d7c-9fc7-360ac245c4a7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f4b4861e-a1c6-45e0-a934-67c667a84812"}]}} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:17:23.964099 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.network.neutron [None req-b8801977-72d0-4b54-997b-d017d8fe5f61 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] validate_networks() for [('f4b4861e-a1c6-45e0-a934-67c667a84812', None, None, None, None, None)] {{(pid=118454) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 18:17:24.298333 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-01dca54e-b937-412a-ac88-5db0547b3f97 req-797c093b-2cfb-4975-8558-b3006a22a3d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b1c63c9-4f4b-4c9e-91da-42f88fd63286", "name": "network-vif-unplugged", "status": "completed", "tag": "1d258458-0cee-481c-93c4-bf0b858d9e28"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:17:24.309234 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-01dca54e-b937-412a-ac88-5db0547b3f97 req-797c093b-2cfb-4975-8558-b3006a22a3d9 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:24.309683 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-01dca54e-b937-412a-ac88-5db0547b3f97 req-797c093b-2cfb-4975-8558-b3006a22a3d9 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:24.321929 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-01dca54e-b937-412a-ac88-5db0547b3f97 req-797c093b-2cfb-4975-8558-b3006a22a3d9 service nova] Creating event network-vif-unplugged:1d258458-0cee-481c-93c4-bf0b858d9e28 for instance 2b1c63c9-4f4b-4c9e-91da-42f88fd63286 on hv-cinder-84617 Jul 28 18:17:24.326988 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-01dca54e-b937-412a-ac88-5db0547b3f97 req-797c093b-2cfb-4975-8558-b3006a22a3d9 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032841 Jul 28 18:17:24.327585 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 243/490] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:17:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 18:17:24.360573 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.virt.hardware [None req-b8801977-72d0-4b54-997b-d017d8fe5f61 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Flavor limits 0:0:0 {{(pid=118454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 18:17:24.361067 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.virt.hardware [None req-b8801977-72d0-4b54-997b-d017d8fe5f61 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Image limits 0:0:0 {{(pid=118454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 18:17:24.364599 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.virt.hardware [None req-b8801977-72d0-4b54-997b-d017d8fe5f61 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Flavor pref 0:0:0 {{(pid=118454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 18:17:24.364599 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.virt.hardware [None req-b8801977-72d0-4b54-997b-d017d8fe5f61 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Image pref 0:0:0 {{(pid=118454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 18:17:24.364599 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.virt.hardware [None req-b8801977-72d0-4b54-997b-d017d8fe5f61 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 18:17:24.372617 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b8801977-72d0-4b54-997b-d017d8fe5f61 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:24.373100 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b8801977-72d0-4b54-997b-d017d8fe5f61 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:24.373938 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b8801977-72d0-4b54-997b-d017d8fe5f61 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:24.374368 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b8801977-72d0-4b54-997b-d017d8fe5f61 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:24.392181 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.quota [None req-b8801977-72d0-4b54-997b-d017d8fe5f61 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Getting quotas for project 308e6cf086ae4cdea9c591ed2811c976. Resources: {'cores', 'ram', 'instances'} {{(pid=118454) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 18:17:24.396829 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.quota [None req-b8801977-72d0-4b54-997b-d017d8fe5f61 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Getting quotas for user 30f0002d2a5a4950b2f1aa771f33bbc1 and project 308e6cf086ae4cdea9c591ed2811c976. Resources: {'cores', 'ram', 'instances'} {{(pid=118454) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 18:17:24.461902 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-b8801977-72d0-4b54-997b-d017d8fe5f61 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Going to run 1 instances... {{(pid=118454) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 18:17:24.464267 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-b8801977-72d0-4b54-997b-d017d8fe5f61 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: 60bf3b10-9241-4fb1-9543-46147477634d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ff03e33d-d90d-4d7c-9fc7-360ac245c4a7',volume_size=None,volume_type=None)] {{(pid=118454) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 18:17:24.632886 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-edaef0b0-a9f6-4f3b-8415-472bd3ecea82 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:24.633616 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-edaef0b0-a9f6-4f3b-8415-472bd3ecea82 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:24.639960 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-edaef0b0-a9f6-4f3b-8415-472bd3ecea82 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:24.643222 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-edaef0b0-a9f6-4f3b-8415-472bd3ecea82 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:24.643222 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-edaef0b0-a9f6-4f3b-8415-472bd3ecea82 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:24.643222 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-edaef0b0-a9f6-4f3b-8415-472bd3ecea82 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:24.778851 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-edaef0b0-a9f6-4f3b-8415-472bd3ecea82 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:24.789077 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-edaef0b0-a9f6-4f3b-8415-472bd3ecea82 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:24.791314 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-edaef0b0-a9f6-4f3b-8415-472bd3ecea82 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:24.792521 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-edaef0b0-a9f6-4f3b-8415-472bd3ecea82 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1719 microversion: 2.20 time: 0.164519 Jul 28 18:17:24.793095 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 244/491] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:17:24 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1719 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:17:24.901312 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b8801977-72d0-4b54-997b-d017d8fe5f61 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [962d8db1-22de-41dd-aa25-7a1947bea151] AMQP server on 10.222.0.86:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 28 18:17:25.815825 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f4092556-6f54-4d2d-a381-bbac2301067a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:25.816439 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f4092556-6f54-4d2d-a381-bbac2301067a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:25.824020 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f4092556-6f54-4d2d-a381-bbac2301067a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:25.824525 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f4092556-6f54-4d2d-a381-bbac2301067a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:25.825333 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f4092556-6f54-4d2d-a381-bbac2301067a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:25.825777 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f4092556-6f54-4d2d-a381-bbac2301067a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:25.908345 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO oslo.messaging._drivers.impl_rabbit [None req-b8801977-72d0-4b54-997b-d017d8fe5f61 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [962d8db1-22de-41dd-aa25-7a1947bea151] Reconnected to AMQP server on 10.222.0.86:5672 via [amqp] client with port 51096. Jul 28 18:17:25.919981 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-b8801977-72d0-4b54-997b-d017d8fe5f61 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.079083 Jul 28 18:17:25.920834 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 248/492] 10.222.0.86 () {60 vars in 1147 bytes} [Thu Jul 28 18:17:23 2022] POST /compute/v2.1/servers => generated 405 bytes in 2081 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 18:17:25.938837 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-a66fc66b-0078-4962-a9cc-fc1b2cfa7ecc tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:25.940539 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-a66fc66b-0078-4962-a9cc-fc1b2cfa7ecc tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: 60bf3b10-9241-4fb1-9543-46147477634d] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:25.987282 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f4092556-6f54-4d2d-a381-bbac2301067a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:26.000504 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f4092556-6f54-4d2d-a381-bbac2301067a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:26.009390 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f4092556-6f54-4d2d-a381-bbac2301067a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:26.009390 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f4092556-6f54-4d2d-a381-bbac2301067a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1722 microversion: 2.20 time: 0.196236 Jul 28 18:17:26.009390 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 245/493] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:17:25 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:17:26.030572 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3bc99bca-ed53-4cc8-9eb0-1e4bc11c645d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "51b95e52-f117-45ea-a8ef-f82ae5f341bb"}} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:17:26.032893 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3bc99bca-ed53-4cc8-9eb0-1e4bc11c645d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:26.040259 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3bc99bca-ed53-4cc8-9eb0-1e4bc11c645d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:26.041062 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3bc99bca-ed53-4cc8-9eb0-1e4bc11c645d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:26.042298 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3bc99bca-ed53-4cc8-9eb0-1e4bc11c645d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:26.042820 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3bc99bca-ed53-4cc8-9eb0-1e4bc11c645d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:26.181281 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-a66fc66b-0078-4962-a9cc-fc1b2cfa7ecc tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:26.190422 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-a66fc66b-0078-4962-a9cc-fc1b2cfa7ecc tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d" status: 200 len: 1093 microversion: 2.1 time: 0.258388 Jul 28 18:17:26.191197 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 249/494] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:17:25 2022] GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d => generated 1093 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:17:27.100091 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-3bc99bca-ed53-4cc8-9eb0-1e4bc11c645d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "POST /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.073502 Jul 28 18:17:27.100952 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 246/495] 10.222.0.86 () {62 vars in 1364 bytes} [Thu Jul 28 18:17:26 2022] POST /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286/os-volume_attachments => generated 188 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 18:17:27.212881 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-dd5bd1b0-4c14-4a1c-9e82-4041f78c73c3 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:27.213576 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-dd5bd1b0-4c14-4a1c-9e82-4041f78c73c3 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: 60bf3b10-9241-4fb1-9543-46147477634d] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:27.232701 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-6b1c2337-004b-4c20-bdc3-7cdcfbf2c783 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:17:27.233317 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-6b1c2337-004b-4c20-bdc3-7cdcfbf2c783 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:27.239982 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6b1c2337-004b-4c20-bdc3-7cdcfbf2c783 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:27.240426 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6b1c2337-004b-4c20-bdc3-7cdcfbf2c783 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:27.241221 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6b1c2337-004b-4c20-bdc3-7cdcfbf2c783 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:27.241662 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6b1c2337-004b-4c20-bdc3-7cdcfbf2c783 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:27.514448 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-dd5bd1b0-4c14-4a1c-9e82-4041f78c73c3 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:27.519851 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-6b1c2337-004b-4c20-bdc3-7cdcfbf2c783 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118453) unshelve /opt/stack/nova/nova/compute/api.py:4532}} Jul 28 18:17:27.521851 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-dd5bd1b0-4c14-4a1c-9e82-4041f78c73c3 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d" status: 200 len: 1093 microversion: 2.1 time: 0.313980 Jul 28 18:17:27.522412 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 250/496] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:17:27 2022] GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d => generated 1093 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:17:27.794046 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-6b1c2337-004b-4c20-bdc3-7cdcfbf2c783 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "POST /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286/action" status: 202 len: 0 microversion: 2.20 time: 0.565064 Jul 28 18:17:27.794825 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 247/497] 10.222.0.86 () {62 vars in 1319 bytes} [Thu Jul 28 18:17:27 2022] POST /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286/action => generated 0 bytes in 567 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 28 18:17:27.803479 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-249c3238-07b2-4379-8605-454bebbc7e12 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:27.804398 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-249c3238-07b2-4379-8605-454bebbc7e12 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:27.810688 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-249c3238-07b2-4379-8605-454bebbc7e12 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:27.811340 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-249c3238-07b2-4379-8605-454bebbc7e12 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:27.812128 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-249c3238-07b2-4379-8605-454bebbc7e12 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:27.812570 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-249c3238-07b2-4379-8605-454bebbc7e12 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:27.944442 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-249c3238-07b2-4379-8605-454bebbc7e12 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:27.953258 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-249c3238-07b2-4379-8605-454bebbc7e12 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:27.954765 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-249c3238-07b2-4379-8605-454bebbc7e12 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:27.956049 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-249c3238-07b2-4379-8605-454bebbc7e12 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1748 microversion: 2.20 time: 0.157021 Jul 28 18:17:27.956595 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 251/498] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:17:27 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1748 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:17:28.542057 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a5bc23f7-c9cd-4b27-b8b7-a8c953e9a768 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:28.542672 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-a5bc23f7-c9cd-4b27-b8b7-a8c953e9a768 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: 60bf3b10-9241-4fb1-9543-46147477634d] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:28.548761 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a5bc23f7-c9cd-4b27-b8b7-a8c953e9a768 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:28.549246 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a5bc23f7-c9cd-4b27-b8b7-a8c953e9a768 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:28.550016 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a5bc23f7-c9cd-4b27-b8b7-a8c953e9a768 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:28.550455 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a5bc23f7-c9cd-4b27-b8b7-a8c953e9a768 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:28.669133 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-a5bc23f7-c9cd-4b27-b8b7-a8c953e9a768 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:28.676364 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-a5bc23f7-c9cd-4b27-b8b7-a8c953e9a768 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d" status: 200 len: 1143 microversion: 2.1 time: 0.138119 Jul 28 18:17:28.676924 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 248/499] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:17:28 2022] GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d => generated 1143 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:17:28.979589 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-27e61204-4a86-4012-b845-63c537ad65a3 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:28.980202 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-27e61204-4a86-4012-b845-63c537ad65a3 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:28.986659 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-27e61204-4a86-4012-b845-63c537ad65a3 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:28.987107 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-27e61204-4a86-4012-b845-63c537ad65a3 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:28.987872 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-27e61204-4a86-4012-b845-63c537ad65a3 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:28.988310 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-27e61204-4a86-4012-b845-63c537ad65a3 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:29.122691 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-27e61204-4a86-4012-b845-63c537ad65a3 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:29.131709 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-27e61204-4a86-4012-b845-63c537ad65a3 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:29.133290 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-27e61204-4a86-4012-b845-63c537ad65a3 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:29.134517 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-27e61204-4a86-4012-b845-63c537ad65a3 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1748 microversion: 2.20 time: 0.158818 Jul 28 18:17:29.135085 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 252/500] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:17:28 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1748 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:17:29.695983 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-2dc721eb-963d-474e-b75d-0b5cbf377760 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:29.696595 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-2dc721eb-963d-474e-b75d-0b5cbf377760 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: 60bf3b10-9241-4fb1-9543-46147477634d] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:29.698727 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell0:SELECT=4 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:17:29.706800 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2dc721eb-963d-474e-b75d-0b5cbf377760 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:29.706800 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2dc721eb-963d-474e-b75d-0b5cbf377760 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:29.706800 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2dc721eb-963d-474e-b75d-0b5cbf377760 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:29.706800 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2dc721eb-963d-474e-b75d-0b5cbf377760 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:29.765632 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-2dc721eb-963d-474e-b75d-0b5cbf377760 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:29.773476 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-2dc721eb-963d-474e-b75d-0b5cbf377760 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d" status: 200 len: 1143 microversion: 2.1 time: 0.081384 Jul 28 18:17:29.774047 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 249/501] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:17:29 2022] GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d => generated 1143 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:17:30.157447 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-c3ec2170-d531-40fb-892f-cd3a32dd29eb tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:30.158047 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-c3ec2170-d531-40fb-892f-cd3a32dd29eb tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:30.175133 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c3ec2170-d531-40fb-892f-cd3a32dd29eb tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:30.175582 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c3ec2170-d531-40fb-892f-cd3a32dd29eb tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:30.176343 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c3ec2170-d531-40fb-892f-cd3a32dd29eb tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:30.176772 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c3ec2170-d531-40fb-892f-cd3a32dd29eb tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:30.323524 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-c3ec2170-d531-40fb-892f-cd3a32dd29eb tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:30.332278 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-c3ec2170-d531-40fb-892f-cd3a32dd29eb tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:30.340850 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-c3ec2170-d531-40fb-892f-cd3a32dd29eb tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:30.340850 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-c3ec2170-d531-40fb-892f-cd3a32dd29eb tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1748 microversion: 2.20 time: 0.181510 Jul 28 18:17:30.340850 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 253/502] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:17:30 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1748 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:17:30.794316 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-62c4a4f1-8cdd-424d-bf78-ceb958b9ea78 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:30.794880 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-62c4a4f1-8cdd-424d-bf78-ceb958b9ea78 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: 60bf3b10-9241-4fb1-9543-46147477634d] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:30.800885 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-62c4a4f1-8cdd-424d-bf78-ceb958b9ea78 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:30.801363 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-62c4a4f1-8cdd-424d-bf78-ceb958b9ea78 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:30.802797 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-62c4a4f1-8cdd-424d-bf78-ceb958b9ea78 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:30.803235 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-62c4a4f1-8cdd-424d-bf78-ceb958b9ea78 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:30.866284 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-62c4a4f1-8cdd-424d-bf78-ceb958b9ea78 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:30.873678 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-62c4a4f1-8cdd-424d-bf78-ceb958b9ea78 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d" status: 200 len: 1143 microversion: 2.1 time: 0.083214 Jul 28 18:17:30.874230 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 250/503] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:17:30 2022] GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d => generated 1143 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:17:31.361959 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-122f699e-7733-46f7-990a-005071acc089 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:31.362578 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-122f699e-7733-46f7-990a-005071acc089 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:31.369164 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-122f699e-7733-46f7-990a-005071acc089 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:31.369618 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-122f699e-7733-46f7-990a-005071acc089 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:31.370390 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-122f699e-7733-46f7-990a-005071acc089 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:31.370827 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-122f699e-7733-46f7-990a-005071acc089 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:31.499201 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-122f699e-7733-46f7-990a-005071acc089 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:31.508028 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-122f699e-7733-46f7-990a-005071acc089 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:31.509591 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-122f699e-7733-46f7-990a-005071acc089 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:31.510707 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-122f699e-7733-46f7-990a-005071acc089 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1748 microversion: 2.20 time: 0.152633 Jul 28 18:17:31.511253 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 254/504] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:17:31 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1748 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:17:31.896387 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a419f990-97bf-4e12-868d-e039646982f7 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:31.897013 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-a419f990-97bf-4e12-868d-e039646982f7 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: 60bf3b10-9241-4fb1-9543-46147477634d] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:31.903130 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a419f990-97bf-4e12-868d-e039646982f7 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:31.903580 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a419f990-97bf-4e12-868d-e039646982f7 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:31.904343 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a419f990-97bf-4e12-868d-e039646982f7 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:31.904781 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a419f990-97bf-4e12-868d-e039646982f7 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:31.971962 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-a419f990-97bf-4e12-868d-e039646982f7 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:31.979638 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-a419f990-97bf-4e12-868d-e039646982f7 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d" status: 200 len: 1143 microversion: 2.1 time: 0.089268 Jul 28 18:17:31.980208 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 251/505] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:17:31 2022] GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d => generated 1143 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:17:32.533104 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-38a7d918-a3f2-4f28-a9f0-f8ea6a777767 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:32.533746 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-38a7d918-a3f2-4f28-a9f0-f8ea6a777767 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:32.540717 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-38a7d918-a3f2-4f28-a9f0-f8ea6a777767 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:32.541229 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-38a7d918-a3f2-4f28-a9f0-f8ea6a777767 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:32.542008 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-38a7d918-a3f2-4f28-a9f0-f8ea6a777767 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:32.542437 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-38a7d918-a3f2-4f28-a9f0-f8ea6a777767 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:32.677292 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-38a7d918-a3f2-4f28-a9f0-f8ea6a777767 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:32.685517 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-38a7d918-a3f2-4f28-a9f0-f8ea6a777767 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:32.687008 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-38a7d918-a3f2-4f28-a9f0-f8ea6a777767 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:32.688147 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-38a7d918-a3f2-4f28-a9f0-f8ea6a777767 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1748 microversion: 2.20 time: 0.158971 Jul 28 18:17:32.688694 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 255/506] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:17:32 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1748 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:17:32.999956 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-25ba4123-36cb-4804-9972-6389e9d17ceb tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:33.000566 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-25ba4123-36cb-4804-9972-6389e9d17ceb tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: 60bf3b10-9241-4fb1-9543-46147477634d] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:33.007193 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-25ba4123-36cb-4804-9972-6389e9d17ceb tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:33.007639 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-25ba4123-36cb-4804-9972-6389e9d17ceb tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:33.008400 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-25ba4123-36cb-4804-9972-6389e9d17ceb tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:33.008841 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-25ba4123-36cb-4804-9972-6389e9d17ceb tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:33.067447 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-25ba4123-36cb-4804-9972-6389e9d17ceb tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:33.075301 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-25ba4123-36cb-4804-9972-6389e9d17ceb tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d" status: 200 len: 1143 microversion: 2.1 time: 0.079219 Jul 28 18:17:33.075864 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 252/507] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:17:32 2022] GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d => generated 1143 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:17:33.711725 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-0d3bfd1c-c3d1-44d9-97b2-aaff6e70528c tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:33.712286 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-0d3bfd1c-c3d1-44d9-97b2-aaff6e70528c tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:33.719012 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-0d3bfd1c-c3d1-44d9-97b2-aaff6e70528c tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:33.719457 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-0d3bfd1c-c3d1-44d9-97b2-aaff6e70528c tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:33.720215 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-0d3bfd1c-c3d1-44d9-97b2-aaff6e70528c tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:33.720676 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-0d3bfd1c-c3d1-44d9-97b2-aaff6e70528c tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:33.854088 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-0d3bfd1c-c3d1-44d9-97b2-aaff6e70528c tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:33.862780 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-0d3bfd1c-c3d1-44d9-97b2-aaff6e70528c tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:33.864272 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-0d3bfd1c-c3d1-44d9-97b2-aaff6e70528c tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:33.866088 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-0d3bfd1c-c3d1-44d9-97b2-aaff6e70528c tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1748 microversion: 2.20 time: 0.158531 Jul 28 18:17:33.866639 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 256/508] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:17:33 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1748 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:17:34.096514 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b8d41380-7097-47cc-b1e7-d05ef7394613 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:34.097277 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b8d41380-7097-47cc-b1e7-d05ef7394613 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: 60bf3b10-9241-4fb1-9543-46147477634d] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:34.104175 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b8d41380-7097-47cc-b1e7-d05ef7394613 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:34.104627 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b8d41380-7097-47cc-b1e7-d05ef7394613 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:34.105430 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b8d41380-7097-47cc-b1e7-d05ef7394613 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:34.105872 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b8d41380-7097-47cc-b1e7-d05ef7394613 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:34.164556 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b8d41380-7097-47cc-b1e7-d05ef7394613 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:34.171914 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b8d41380-7097-47cc-b1e7-d05ef7394613 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d" status: 200 len: 1143 microversion: 2.1 time: 0.079336 Jul 28 18:17:34.172696 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 253/509] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:17:34 2022] GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d => generated 1143 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:17:34.888760 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-1b725899-4290-4dfd-8d55-726db347a984 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:34.889312 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-1b725899-4290-4dfd-8d55-726db347a984 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:34.895427 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell0:SELECT=2 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:17:34.897997 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-1b725899-4290-4dfd-8d55-726db347a984 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:34.899178 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-1b725899-4290-4dfd-8d55-726db347a984 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:34.900042 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-1b725899-4290-4dfd-8d55-726db347a984 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:34.900588 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-1b725899-4290-4dfd-8d55-726db347a984 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:35.146565 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-1b725899-4290-4dfd-8d55-726db347a984 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:35.154949 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-1b725899-4290-4dfd-8d55-726db347a984 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:35.156482 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-1b725899-4290-4dfd-8d55-726db347a984 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:35.157703 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-1b725899-4290-4dfd-8d55-726db347a984 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1750 microversion: 2.20 time: 0.273880 Jul 28 18:17:35.158264 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 257/510] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:17:34 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1750 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:17:35.191687 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3c64c1f1-d40b-4d7e-9921-ef6e52bc7718 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:35.192288 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3c64c1f1-d40b-4d7e-9921-ef6e52bc7718 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: 60bf3b10-9241-4fb1-9543-46147477634d] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:35.198474 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3c64c1f1-d40b-4d7e-9921-ef6e52bc7718 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:35.198919 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3c64c1f1-d40b-4d7e-9921-ef6e52bc7718 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:35.199673 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3c64c1f1-d40b-4d7e-9921-ef6e52bc7718 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:35.200102 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3c64c1f1-d40b-4d7e-9921-ef6e52bc7718 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:35.261340 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-3c64c1f1-d40b-4d7e-9921-ef6e52bc7718 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:35.268688 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-3c64c1f1-d40b-4d7e-9921-ef6e52bc7718 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d" status: 200 len: 1191 microversion: 2.1 time: 0.080886 Jul 28 18:17:35.269285 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 254/511] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:17:35 2022] GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d => generated 1191 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:17:36.181289 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-e0af779b-310a-4c09-a201-6be7371a8978 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:36.182098 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-e0af779b-310a-4c09-a201-6be7371a8978 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:36.184578 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:17:36.189574 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e0af779b-310a-4c09-a201-6be7371a8978 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:36.190123 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e0af779b-310a-4c09-a201-6be7371a8978 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:36.190963 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e0af779b-310a-4c09-a201-6be7371a8978 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:36.191476 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e0af779b-310a-4c09-a201-6be7371a8978 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:36.289223 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-2b1b6bdb-da9f-490c-8eb9-50c51972a275 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:36.289913 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-2b1b6bdb-da9f-490c-8eb9-50c51972a275 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: 60bf3b10-9241-4fb1-9543-46147477634d] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:36.291978 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:17:36.296721 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2b1b6bdb-da9f-490c-8eb9-50c51972a275 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:36.300676 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2b1b6bdb-da9f-490c-8eb9-50c51972a275 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:36.300676 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2b1b6bdb-da9f-490c-8eb9-50c51972a275 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:36.300676 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2b1b6bdb-da9f-490c-8eb9-50c51972a275 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:36.384992 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-2b1b6bdb-da9f-490c-8eb9-50c51972a275 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:36.393424 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-2b1b6bdb-da9f-490c-8eb9-50c51972a275 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d" status: 200 len: 1209 microversion: 2.1 time: 0.107931 Jul 28 18:17:36.394014 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 255/512] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:17:36 2022] GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d => generated 1209 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:17:36.436118 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-e0af779b-310a-4c09-a201-6be7371a8978 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:36.445551 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-e0af779b-310a-4c09-a201-6be7371a8978 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:36.447100 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-e0af779b-310a-4c09-a201-6be7371a8978 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:36.448501 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-e0af779b-310a-4c09-a201-6be7371a8978 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1750 microversion: 2.20 time: 0.271014 Jul 28 18:17:36.448838 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 258/513] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:17:36 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1750 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:17:37.423649 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-1406bf19-cb1d-4003-939c-2ae03d55a85b tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:37.424264 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-1406bf19-cb1d-4003-939c-2ae03d55a85b tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: 60bf3b10-9241-4fb1-9543-46147477634d] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:37.432117 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1406bf19-cb1d-4003-939c-2ae03d55a85b tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:37.432572 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1406bf19-cb1d-4003-939c-2ae03d55a85b tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:37.433377 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1406bf19-cb1d-4003-939c-2ae03d55a85b tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:37.433814 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1406bf19-cb1d-4003-939c-2ae03d55a85b tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:37.438159 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:17:37.471225 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-a749c526-f200-4fde-8989-ff72956eb697 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:37.471816 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-a749c526-f200-4fde-8989-ff72956eb697 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:37.478774 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a749c526-f200-4fde-8989-ff72956eb697 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:37.479224 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a749c526-f200-4fde-8989-ff72956eb697 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:37.480006 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a749c526-f200-4fde-8989-ff72956eb697 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:37.480443 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a749c526-f200-4fde-8989-ff72956eb697 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:37.518824 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell0:SELECT=10 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:17:37.700764 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-1406bf19-cb1d-4003-939c-2ae03d55a85b tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:37.711196 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-1406bf19-cb1d-4003-939c-2ae03d55a85b tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d" status: 200 len: 1276 microversion: 2.1 time: 0.289816 Jul 28 18:17:37.725425 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 256/514] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:17:37 2022] GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d => generated 1276 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:17:37.725425 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-d2f4f26a-a160-42e0-b42d-0153e1c37dd1 req-16bbb7e6-392d-4f42-8db3-a691c2fe5cde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60bf3b10-9241-4fb1-9543-46147477634d", "tag": "c9c5491c-fa11-47ad-bc68-d27692005b9b"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:17:37.729672 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-d2f4f26a-a160-42e0-b42d-0153e1c37dd1 req-16bbb7e6-392d-4f42-8db3-a691c2fe5cde service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:37.730197 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-d2f4f26a-a160-42e0-b42d-0153e1c37dd1 req-16bbb7e6-392d-4f42-8db3-a691c2fe5cde service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:37.731373 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-a749c526-f200-4fde-8989-ff72956eb697 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:37.743246 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-a749c526-f200-4fde-8989-ff72956eb697 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:37.746708 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-a749c526-f200-4fde-8989-ff72956eb697 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:37.748299 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-a749c526-f200-4fde-8989-ff72956eb697 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1750 microversion: 2.20 time: 0.280943 Jul 28 18:17:37.757837 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-d2f4f26a-a160-42e0-b42d-0153e1c37dd1 req-16bbb7e6-392d-4f42-8db3-a691c2fe5cde service nova] Creating event network-changed:c9c5491c-fa11-47ad-bc68-d27692005b9b for instance 60bf3b10-9241-4fb1-9543-46147477634d on hv-cinder-84617 Jul 28 18:17:37.773157 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 259/515] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:17:37 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1750 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:17:37.775010 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-d2f4f26a-a160-42e0-b42d-0153e1c37dd1 req-16bbb7e6-392d-4f42-8db3-a691c2fe5cde service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061235 Jul 28 18:17:37.775830 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 257/516] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:17:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:17:38.732817 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-61271d52-de3b-4d1a-b800-f0cd6df4551d tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:38.733563 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-61271d52-de3b-4d1a-b800-f0cd6df4551d tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: 60bf3b10-9241-4fb1-9543-46147477634d] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:38.740199 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-61271d52-de3b-4d1a-b800-f0cd6df4551d tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:38.742024 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-61271d52-de3b-4d1a-b800-f0cd6df4551d tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:38.742024 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-61271d52-de3b-4d1a-b800-f0cd6df4551d tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:38.742024 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-61271d52-de3b-4d1a-b800-f0cd6df4551d tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:38.779566 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-62de9b48-4d17-4ca9-afee-25c92cb0f9e8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:38.780267 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-62de9b48-4d17-4ca9-afee-25c92cb0f9e8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:38.787372 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-62de9b48-4d17-4ca9-afee-25c92cb0f9e8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:38.788419 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-62de9b48-4d17-4ca9-afee-25c92cb0f9e8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:38.789426 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-62de9b48-4d17-4ca9-afee-25c92cb0f9e8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:38.790069 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-62de9b48-4d17-4ca9-afee-25c92cb0f9e8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:38.950411 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-61271d52-de3b-4d1a-b800-f0cd6df4551d tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:38.957801 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-61271d52-de3b-4d1a-b800-f0cd6df4551d tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d" status: 200 len: 1276 microversion: 2.1 time: 0.228799 Jul 28 18:17:38.958636 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 260/517] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:17:38 2022] GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d => generated 1276 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:17:38.975370 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-62de9b48-4d17-4ca9-afee-25c92cb0f9e8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:38.983708 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-62de9b48-4d17-4ca9-afee-25c92cb0f9e8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:38.985224 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-62de9b48-4d17-4ca9-afee-25c92cb0f9e8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:38.986431 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-62de9b48-4d17-4ca9-afee-25c92cb0f9e8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1750 microversion: 2.20 time: 0.211670 Jul 28 18:17:38.986979 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 258/518] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:17:38 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1750 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:17:39.979797 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-a33d3da3-75bd-48e0-902e-24630cd60b46 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:39.980495 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-a33d3da3-75bd-48e0-902e-24630cd60b46 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: 60bf3b10-9241-4fb1-9543-46147477634d] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:39.987099 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a33d3da3-75bd-48e0-902e-24630cd60b46 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:39.987554 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a33d3da3-75bd-48e0-902e-24630cd60b46 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:39.988322 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a33d3da3-75bd-48e0-902e-24630cd60b46 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:39.988765 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a33d3da3-75bd-48e0-902e-24630cd60b46 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:40.009729 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-c258f495-33db-45cf-a032-b00849cea540 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:40.010462 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-c258f495-33db-45cf-a032-b00849cea540 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:40.016637 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c258f495-33db-45cf-a032-b00849cea540 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:40.017137 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c258f495-33db-45cf-a032-b00849cea540 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:40.017907 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c258f495-33db-45cf-a032-b00849cea540 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:40.018346 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c258f495-33db-45cf-a032-b00849cea540 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:40.194044 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-a33d3da3-75bd-48e0-902e-24630cd60b46 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:40.198529 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-c258f495-33db-45cf-a032-b00849cea540 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:40.202240 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-a33d3da3-75bd-48e0-902e-24630cd60b46 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d" status: 200 len: 1276 microversion: 2.1 time: 0.226408 Jul 28 18:17:40.202821 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 261/519] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:17:39 2022] GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d => generated 1276 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:17:40.206831 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-c258f495-33db-45cf-a032-b00849cea540 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:40.208311 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-c258f495-33db-45cf-a032-b00849cea540 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:40.209468 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-c258f495-33db-45cf-a032-b00849cea540 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1750 microversion: 2.20 time: 0.204349 Jul 28 18:17:40.210015 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 259/520] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:17:40 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1750 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:17:41.223386 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-31bf77a8-286b-4923-8160-2b3af57c2192 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:41.223982 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-31bf77a8-286b-4923-8160-2b3af57c2192 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: 60bf3b10-9241-4fb1-9543-46147477634d] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:41.230990 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-31bf77a8-286b-4923-8160-2b3af57c2192 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:41.235889 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-31bf77a8-286b-4923-8160-2b3af57c2192 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:41.236011 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-78e5cb1e-8ae6-4d56-b12c-c7e4600d4285 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:41.236011 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-78e5cb1e-8ae6-4d56-b12c-c7e4600d4285 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:41.236535 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-31bf77a8-286b-4923-8160-2b3af57c2192 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:41.236535 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-31bf77a8-286b-4923-8160-2b3af57c2192 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:41.238145 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-78e5cb1e-8ae6-4d56-b12c-c7e4600d4285 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:41.238608 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-78e5cb1e-8ae6-4d56-b12c-c7e4600d4285 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:41.239379 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-78e5cb1e-8ae6-4d56-b12c-c7e4600d4285 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:41.239820 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-78e5cb1e-8ae6-4d56-b12c-c7e4600d4285 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:41.427774 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-78e5cb1e-8ae6-4d56-b12c-c7e4600d4285 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:41.437028 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-78e5cb1e-8ae6-4d56-b12c-c7e4600d4285 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:41.437615 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-31bf77a8-286b-4923-8160-2b3af57c2192 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:41.438631 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-78e5cb1e-8ae6-4d56-b12c-c7e4600d4285 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:41.439849 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-78e5cb1e-8ae6-4d56-b12c-c7e4600d4285 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1750 microversion: 2.20 time: 0.212147 Jul 28 18:17:41.440471 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 260/521] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:17:41 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1750 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:17:41.446016 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-31bf77a8-286b-4923-8160-2b3af57c2192 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d" status: 200 len: 1276 microversion: 2.1 time: 0.226568 Jul 28 18:17:41.446578 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 262/522] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:17:41 2022] GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d => generated 1276 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:17:42.463366 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0d806d54-6b29-4ff5-a33f-e593a0b539fe tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:42.463974 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0d806d54-6b29-4ff5-a33f-e593a0b539fe tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:42.467181 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-d933778a-5ed2-45fc-a811-144a713014f4 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:42.467868 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-d933778a-5ed2-45fc-a811-144a713014f4 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: 60bf3b10-9241-4fb1-9543-46147477634d] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:42.470871 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0d806d54-6b29-4ff5-a33f-e593a0b539fe tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:42.473709 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0d806d54-6b29-4ff5-a33f-e593a0b539fe tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:42.473709 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0d806d54-6b29-4ff5-a33f-e593a0b539fe tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:42.473709 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0d806d54-6b29-4ff5-a33f-e593a0b539fe tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:42.474543 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d933778a-5ed2-45fc-a811-144a713014f4 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:42.475036 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d933778a-5ed2-45fc-a811-144a713014f4 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:42.476531 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d933778a-5ed2-45fc-a811-144a713014f4 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:42.477025 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d933778a-5ed2-45fc-a811-144a713014f4 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:42.686272 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-0d806d54-6b29-4ff5-a33f-e593a0b539fe tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:42.697289 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-0d806d54-6b29-4ff5-a33f-e593a0b539fe tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:42.699052 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-0d806d54-6b29-4ff5-a33f-e593a0b539fe tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:42.700474 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0d806d54-6b29-4ff5-a33f-e593a0b539fe tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1750 microversion: 2.20 time: 0.241638 Jul 28 18:17:42.701059 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 261/523] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:17:42 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1750 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:17:42.707916 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-d933778a-5ed2-45fc-a811-144a713014f4 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:42.718634 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-d933778a-5ed2-45fc-a811-144a713014f4 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d" status: 200 len: 1276 microversion: 2.1 time: 0.255737 Jul 28 18:17:42.719514 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 263/524] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:17:42 2022] GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d => generated 1276 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:17:43.723557 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-897498b8-4b69-4937-8ec6-df2106d9d5b8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:43.724164 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-897498b8-4b69-4937-8ec6-df2106d9d5b8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:43.730335 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-897498b8-4b69-4937-8ec6-df2106d9d5b8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:43.730782 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-897498b8-4b69-4937-8ec6-df2106d9d5b8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:43.731538 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-897498b8-4b69-4937-8ec6-df2106d9d5b8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:43.731970 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-897498b8-4b69-4937-8ec6-df2106d9d5b8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:43.739382 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-c906f240-fedb-4d64-8fa7-363d194fcab4 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:43.740149 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-c906f240-fedb-4d64-8fa7-363d194fcab4 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: 60bf3b10-9241-4fb1-9543-46147477634d] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:43.747336 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c906f240-fedb-4d64-8fa7-363d194fcab4 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:43.747791 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c906f240-fedb-4d64-8fa7-363d194fcab4 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:43.748563 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c906f240-fedb-4d64-8fa7-363d194fcab4 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:43.749059 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c906f240-fedb-4d64-8fa7-363d194fcab4 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:43.943588 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-897498b8-4b69-4937-8ec6-df2106d9d5b8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:43.947212 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-c906f240-fedb-4d64-8fa7-363d194fcab4 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:43.954940 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-c906f240-fedb-4d64-8fa7-363d194fcab4 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d" status: 200 len: 1276 microversion: 2.1 time: 0.219537 Jul 28 18:17:43.955521 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 264/525] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:17:43 2022] GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d => generated 1276 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:17:43.966215 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-897498b8-4b69-4937-8ec6-df2106d9d5b8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:43.968072 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-897498b8-4b69-4937-8ec6-df2106d9d5b8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:43.969628 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-897498b8-4b69-4937-8ec6-df2106d9d5b8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1806 microversion: 2.20 time: 0.249755 Jul 28 18:17:43.970371 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 262/526] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:17:43 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1806 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:17:44.975619 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-38ac8e71-580e-4b2b-ad37-5f2a60d3ae02 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:44.976369 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-38ac8e71-580e-4b2b-ad37-5f2a60d3ae02 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: 60bf3b10-9241-4fb1-9543-46147477634d] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:44.982819 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-38ac8e71-580e-4b2b-ad37-5f2a60d3ae02 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:44.983361 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-38ac8e71-580e-4b2b-ad37-5f2a60d3ae02 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:44.984191 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-38ac8e71-580e-4b2b-ad37-5f2a60d3ae02 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:44.984698 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-38ac8e71-580e-4b2b-ad37-5f2a60d3ae02 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:44.989499 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell1:SELECT=100 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:17:44.997708 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-782f788e-1c7f-428b-b4a3-76766beda597 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:45.002814 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-782f788e-1c7f-428b-b4a3-76766beda597 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:45.005721 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-782f788e-1c7f-428b-b4a3-76766beda597 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:45.006281 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-782f788e-1c7f-428b-b4a3-76766beda597 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:45.007598 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-782f788e-1c7f-428b-b4a3-76766beda597 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:45.008032 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-782f788e-1c7f-428b-b4a3-76766beda597 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:45.419414 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-38ac8e71-580e-4b2b-ad37-5f2a60d3ae02 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:45.434196 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-38ac8e71-580e-4b2b-ad37-5f2a60d3ae02 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d" status: 200 len: 1264 microversion: 2.1 time: 0.458741 Jul 28 18:17:45.434196 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 265/527] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:17:44 2022] GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d => generated 1264 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:17:45.448005 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-782f788e-1c7f-428b-b4a3-76766beda597 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:45.456503 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-782f788e-1c7f-428b-b4a3-76766beda597 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:45.458071 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-782f788e-1c7f-428b-b4a3-76766beda597 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:45.463183 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-782f788e-1c7f-428b-b4a3-76766beda597 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1806 microversion: 2.20 time: 0.467523 Jul 28 18:17:45.463183 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 263/528] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:17:44 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1806 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:17:46.453492 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-08de31fd-6297-4fa6-9cd1-c4f978586273 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:46.454110 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-08de31fd-6297-4fa6-9cd1-c4f978586273 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: 60bf3b10-9241-4fb1-9543-46147477634d] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:46.461530 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-08de31fd-6297-4fa6-9cd1-c4f978586273 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:46.462482 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-08de31fd-6297-4fa6-9cd1-c4f978586273 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:46.463276 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-08de31fd-6297-4fa6-9cd1-c4f978586273 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:46.463720 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-08de31fd-6297-4fa6-9cd1-c4f978586273 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:46.484328 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-e2674a0f-5191-485a-b64e-efef944ded3d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:46.485011 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-e2674a0f-5191-485a-b64e-efef944ded3d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:46.491950 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e2674a0f-5191-485a-b64e-efef944ded3d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:46.492473 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e2674a0f-5191-485a-b64e-efef944ded3d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:46.493525 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e2674a0f-5191-485a-b64e-efef944ded3d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:46.494464 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e2674a0f-5191-485a-b64e-efef944ded3d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:46.666217 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-08de31fd-6297-4fa6-9cd1-c4f978586273 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:46.670977 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-e2674a0f-5191-485a-b64e-efef944ded3d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:46.674189 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-08de31fd-6297-4fa6-9cd1-c4f978586273 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d" status: 200 len: 1264 microversion: 2.1 time: 0.224469 Jul 28 18:17:46.680682 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 266/529] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:17:46 2022] GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d => generated 1264 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:17:46.681182 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-e2674a0f-5191-485a-b64e-efef944ded3d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:46.682926 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-e2674a0f-5191-485a-b64e-efef944ded3d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:46.684123 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-e2674a0f-5191-485a-b64e-efef944ded3d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1806 microversion: 2.20 time: 0.204347 Jul 28 18:17:46.684688 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 264/530] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:17:46 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1806 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:17:47.696097 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-93c97be3-568a-435f-a870-8ed2ffb448b1 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:47.696631 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-93c97be3-568a-435f-a870-8ed2ffb448b1 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: 60bf3b10-9241-4fb1-9543-46147477634d] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:47.703297 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-93c97be3-568a-435f-a870-8ed2ffb448b1 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:47.703758 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-93c97be3-568a-435f-a870-8ed2ffb448b1 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:47.704528 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-93c97be3-568a-435f-a870-8ed2ffb448b1 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:47.705005 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-93c97be3-568a-435f-a870-8ed2ffb448b1 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:47.706890 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0d46bae1-3d36-4683-bd6e-99f7566d37f4 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:47.707501 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0d46bae1-3d36-4683-bd6e-99f7566d37f4 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:47.713500 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0d46bae1-3d36-4683-bd6e-99f7566d37f4 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:47.713953 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0d46bae1-3d36-4683-bd6e-99f7566d37f4 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:47.714721 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0d46bae1-3d36-4683-bd6e-99f7566d37f4 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:47.715165 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0d46bae1-3d36-4683-bd6e-99f7566d37f4 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:47.932201 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-0d46bae1-3d36-4683-bd6e-99f7566d37f4 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:47.941844 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-0d46bae1-3d36-4683-bd6e-99f7566d37f4 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:47.946374 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-93c97be3-568a-435f-a870-8ed2ffb448b1 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:47.950696 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-0d46bae1-3d36-4683-bd6e-99f7566d37f4 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:47.951901 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0d46bae1-3d36-4683-bd6e-99f7566d37f4 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1806 microversion: 2.20 time: 0.248824 Jul 28 18:17:47.952656 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 265/531] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:17:47 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1806 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:17:47.954865 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-93c97be3-568a-435f-a870-8ed2ffb448b1 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d" status: 200 len: 1264 microversion: 2.1 time: 0.263247 Jul 28 18:17:47.955973 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 267/532] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:17:47 2022] GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d => generated 1264 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:17:48.974566 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-58981a16-66e0-4de4-ad06-9e53f34aa16f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:48.975233 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-58981a16-66e0-4de4-ad06-9e53f34aa16f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:48.979916 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-96bbdba1-06c3-48c0-90cf-5333eea265de tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:48.980538 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-96bbdba1-06c3-48c0-90cf-5333eea265de tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: 60bf3b10-9241-4fb1-9543-46147477634d] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:48.982055 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-58981a16-66e0-4de4-ad06-9e53f34aa16f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:48.982510 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-58981a16-66e0-4de4-ad06-9e53f34aa16f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:48.983286 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-58981a16-66e0-4de4-ad06-9e53f34aa16f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:48.983728 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-58981a16-66e0-4de4-ad06-9e53f34aa16f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:48.987102 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-96bbdba1-06c3-48c0-90cf-5333eea265de tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:48.987558 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-96bbdba1-06c3-48c0-90cf-5333eea265de tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:48.988331 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-96bbdba1-06c3-48c0-90cf-5333eea265de tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:48.988776 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-96bbdba1-06c3-48c0-90cf-5333eea265de tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:49.188885 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-58981a16-66e0-4de4-ad06-9e53f34aa16f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:49.192368 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-96bbdba1-06c3-48c0-90cf-5333eea265de tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:49.204197 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-58981a16-66e0-4de4-ad06-9e53f34aa16f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:49.204197 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-58981a16-66e0-4de4-ad06-9e53f34aa16f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:49.204476 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-96bbdba1-06c3-48c0-90cf-5333eea265de tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d" status: 200 len: 1264 microversion: 2.1 time: 0.224216 Jul 28 18:17:49.204579 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-58981a16-66e0-4de4-ad06-9e53f34aa16f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1806 microversion: 2.20 time: 0.229637 Jul 28 18:17:49.204677 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 268/533] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:17:48 2022] GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d => generated 1264 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:17:49.204782 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 266/534] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:17:48 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1806 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:17:50.232716 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-00cbb748-f0b6-4883-a0f1-8f0a03e7da24 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:50.235500 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-7bf7d6fe-e282-4427-8850-78fc62de2308 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:50.236564 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-00cbb748-f0b6-4883-a0f1-8f0a03e7da24 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:50.240438 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-7bf7d6fe-e282-4427-8850-78fc62de2308 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: 60bf3b10-9241-4fb1-9543-46147477634d] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:50.245134 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-00cbb748-f0b6-4883-a0f1-8f0a03e7da24 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:50.245591 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-00cbb748-f0b6-4883-a0f1-8f0a03e7da24 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:50.246443 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-00cbb748-f0b6-4883-a0f1-8f0a03e7da24 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:50.246884 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-00cbb748-f0b6-4883-a0f1-8f0a03e7da24 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:50.249125 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-7bf7d6fe-e282-4427-8850-78fc62de2308 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:50.249609 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-7bf7d6fe-e282-4427-8850-78fc62de2308 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:50.250384 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-7bf7d6fe-e282-4427-8850-78fc62de2308 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:50.250825 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-7bf7d6fe-e282-4427-8850-78fc62de2308 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:50.505327 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-00cbb748-f0b6-4883-a0f1-8f0a03e7da24 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:50.507490 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-7bf7d6fe-e282-4427-8850-78fc62de2308 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:50.517534 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-7bf7d6fe-e282-4427-8850-78fc62de2308 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d" status: 200 len: 1264 microversion: 2.1 time: 0.294794 Jul 28 18:17:50.518621 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 269/535] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:17:50 2022] GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d => generated 1264 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:17:50.521104 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-00cbb748-f0b6-4883-a0f1-8f0a03e7da24 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:50.524634 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-00cbb748-f0b6-4883-a0f1-8f0a03e7da24 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:50.528031 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-00cbb748-f0b6-4883-a0f1-8f0a03e7da24 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1806 microversion: 2.20 time: 0.300433 Jul 28 18:17:50.529621 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 267/536] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:17:50 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1806 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:17:51.551687 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-b47543ea-022a-42e9-96f0-b2a92d7bd0a4 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:51.552302 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-b47543ea-022a-42e9-96f0-b2a92d7bd0a4 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:51.556850 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-e43a0c85-ade5-4e04-a6ce-550a1e8565fc tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:51.557494 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-e43a0c85-ade5-4e04-a6ce-550a1e8565fc tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: 60bf3b10-9241-4fb1-9543-46147477634d] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:51.559317 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b47543ea-022a-42e9-96f0-b2a92d7bd0a4 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:51.559773 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b47543ea-022a-42e9-96f0-b2a92d7bd0a4 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:51.560545 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b47543ea-022a-42e9-96f0-b2a92d7bd0a4 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:51.561005 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b47543ea-022a-42e9-96f0-b2a92d7bd0a4 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:51.563816 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e43a0c85-ade5-4e04-a6ce-550a1e8565fc tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:51.564267 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e43a0c85-ade5-4e04-a6ce-550a1e8565fc tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:51.565153 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e43a0c85-ade5-4e04-a6ce-550a1e8565fc tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:51.565582 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e43a0c85-ade5-4e04-a6ce-550a1e8565fc tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:51.792023 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-e43a0c85-ade5-4e04-a6ce-550a1e8565fc tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:51.795048 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-b47543ea-022a-42e9-96f0-b2a92d7bd0a4 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:51.799604 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-e43a0c85-ade5-4e04-a6ce-550a1e8565fc tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d" status: 200 len: 1264 microversion: 2.1 time: 0.246991 Jul 28 18:17:51.800171 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 268/537] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:17:51 2022] GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d => generated 1264 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:17:51.804153 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-b47543ea-022a-42e9-96f0-b2a92d7bd0a4 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:51.805709 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-b47543ea-022a-42e9-96f0-b2a92d7bd0a4 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:51.806874 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-b47543ea-022a-42e9-96f0-b2a92d7bd0a4 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1806 microversion: 2.20 time: 0.259141 Jul 28 18:17:51.807437 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 270/538] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:17:51 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1806 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:17:52.821445 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-98cb93b0-51a2-4a2d-9a4f-7391f71f47e5 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:52.822044 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-98cb93b0-51a2-4a2d-9a4f-7391f71f47e5 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: 60bf3b10-9241-4fb1-9543-46147477634d] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:52.828131 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-98cb93b0-51a2-4a2d-9a4f-7391f71f47e5 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:52.828585 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-98cb93b0-51a2-4a2d-9a4f-7391f71f47e5 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:52.829048 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-43455022-2805-4658-87d5-25be9fbf42ac tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:52.829487 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-98cb93b0-51a2-4a2d-9a4f-7391f71f47e5 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:52.829813 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-98cb93b0-51a2-4a2d-9a4f-7391f71f47e5 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:52.829959 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-43455022-2805-4658-87d5-25be9fbf42ac tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:52.836480 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-43455022-2805-4658-87d5-25be9fbf42ac tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:52.836930 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-43455022-2805-4658-87d5-25be9fbf42ac tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:52.837743 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-43455022-2805-4658-87d5-25be9fbf42ac tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:52.838184 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-43455022-2805-4658-87d5-25be9fbf42ac tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:53.025091 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-98cb93b0-51a2-4a2d-9a4f-7391f71f47e5 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:53.028775 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-43455022-2805-4658-87d5-25be9fbf42ac tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:53.032685 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-98cb93b0-51a2-4a2d-9a4f-7391f71f47e5 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d" status: 200 len: 1264 microversion: 2.1 time: 0.215766 Jul 28 18:17:53.033292 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 269/539] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:17:52 2022] GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d => generated 1264 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:17:53.037245 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-43455022-2805-4658-87d5-25be9fbf42ac tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:53.038787 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-43455022-2805-4658-87d5-25be9fbf42ac tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:53.039939 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-43455022-2805-4658-87d5-25be9fbf42ac tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1806 microversion: 2.20 time: 0.214962 Jul 28 18:17:53.040487 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 271/540] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:17:52 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1806 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:17:54.053531 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a4908c18-ff62-4045-8723-f308cdb9b2ec tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:54.054132 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-a4908c18-ff62-4045-8723-f308cdb9b2ec tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: 60bf3b10-9241-4fb1-9543-46147477634d] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:54.060052 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a4908c18-ff62-4045-8723-f308cdb9b2ec tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:54.060499 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a4908c18-ff62-4045-8723-f308cdb9b2ec tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:54.061297 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a4908c18-ff62-4045-8723-f308cdb9b2ec tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:54.061740 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a4908c18-ff62-4045-8723-f308cdb9b2ec tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:54.062658 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-79f1f3ab-8f89-40f7-ba08-fc7931ba79dc tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:54.063276 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-79f1f3ab-8f89-40f7-ba08-fc7931ba79dc tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:54.070002 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-79f1f3ab-8f89-40f7-ba08-fc7931ba79dc tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:54.070388 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-79f1f3ab-8f89-40f7-ba08-fc7931ba79dc tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:54.071154 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-79f1f3ab-8f89-40f7-ba08-fc7931ba79dc tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:54.071612 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-79f1f3ab-8f89-40f7-ba08-fc7931ba79dc tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:54.259540 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-a4908c18-ff62-4045-8723-f308cdb9b2ec tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:54.271717 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-a4908c18-ff62-4045-8723-f308cdb9b2ec tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d" status: 200 len: 1264 microversion: 2.1 time: 0.222282 Jul 28 18:17:54.275244 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 270/541] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:17:54 2022] GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d => generated 1264 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:17:54.292392 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-79f1f3ab-8f89-40f7-ba08-fc7931ba79dc tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:54.302584 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-79f1f3ab-8f89-40f7-ba08-fc7931ba79dc tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:54.304592 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-79f1f3ab-8f89-40f7-ba08-fc7931ba79dc tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:54.305792 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-79f1f3ab-8f89-40f7-ba08-fc7931ba79dc tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1806 microversion: 2.20 time: 0.246971 Jul 28 18:17:54.306357 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 272/542] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:17:54 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1806 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:17:55.294083 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-22207d11-0562-40ef-ada0-0ecf1bc11bf2 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:55.294687 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-22207d11-0562-40ef-ada0-0ecf1bc11bf2 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: 60bf3b10-9241-4fb1-9543-46147477634d] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:55.300713 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-22207d11-0562-40ef-ada0-0ecf1bc11bf2 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:55.301210 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-22207d11-0562-40ef-ada0-0ecf1bc11bf2 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:55.301977 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-22207d11-0562-40ef-ada0-0ecf1bc11bf2 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:55.302420 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-22207d11-0562-40ef-ada0-0ecf1bc11bf2 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:55.327857 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-69eb1532-02a7-4e20-8620-4ef5cec39463 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:55.328422 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-69eb1532-02a7-4e20-8620-4ef5cec39463 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:55.337437 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-69eb1532-02a7-4e20-8620-4ef5cec39463 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:55.337958 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-69eb1532-02a7-4e20-8620-4ef5cec39463 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:55.338760 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-69eb1532-02a7-4e20-8620-4ef5cec39463 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:55.339296 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-69eb1532-02a7-4e20-8620-4ef5cec39463 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:55.521066 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-22207d11-0562-40ef-ada0-0ecf1bc11bf2 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:55.525616 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-69eb1532-02a7-4e20-8620-4ef5cec39463 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:55.530925 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-22207d11-0562-40ef-ada0-0ecf1bc11bf2 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d" status: 200 len: 1264 microversion: 2.1 time: 0.239456 Jul 28 18:17:55.530925 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 271/543] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:17:55 2022] GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d => generated 1264 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:17:55.544506 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-69eb1532-02a7-4e20-8620-4ef5cec39463 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:55.546061 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-69eb1532-02a7-4e20-8620-4ef5cec39463 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:55.547292 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-69eb1532-02a7-4e20-8620-4ef5cec39463 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1806 microversion: 2.20 time: 0.223503 Jul 28 18:17:55.561664 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 273/544] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:17:55 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1806 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:17:56.550620 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-533e8e98-2f33-4847-b25c-d0735057bc57 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:56.551297 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-533e8e98-2f33-4847-b25c-d0735057bc57 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: 60bf3b10-9241-4fb1-9543-46147477634d] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:56.557829 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-533e8e98-2f33-4847-b25c-d0735057bc57 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:56.558461 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-533e8e98-2f33-4847-b25c-d0735057bc57 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:56.559456 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-533e8e98-2f33-4847-b25c-d0735057bc57 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:56.559958 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-533e8e98-2f33-4847-b25c-d0735057bc57 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:56.571445 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-24be517e-5bac-45ff-b2d1-a065ccc15e69 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:56.572366 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-24be517e-5bac-45ff-b2d1-a065ccc15e69 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:56.582691 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-24be517e-5bac-45ff-b2d1-a065ccc15e69 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:56.583152 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-24be517e-5bac-45ff-b2d1-a065ccc15e69 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:56.584111 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-24be517e-5bac-45ff-b2d1-a065ccc15e69 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:56.585075 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-24be517e-5bac-45ff-b2d1-a065ccc15e69 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:56.779714 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-533e8e98-2f33-4847-b25c-d0735057bc57 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:56.786425 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-24be517e-5bac-45ff-b2d1-a065ccc15e69 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:56.795907 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-533e8e98-2f33-4847-b25c-d0735057bc57 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d" status: 200 len: 1264 microversion: 2.1 time: 0.245302 Jul 28 18:17:56.796069 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-24be517e-5bac-45ff-b2d1-a065ccc15e69 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:56.797194 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-24be517e-5bac-45ff-b2d1-a065ccc15e69 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:56.798595 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-24be517e-5bac-45ff-b2d1-a065ccc15e69 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1806 microversion: 2.20 time: 0.232449 Jul 28 18:17:56.799153 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 274/545] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:17:56 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1806 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:17:56.805628 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 272/546] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:17:56 2022] GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d => generated 1264 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:17:57.814267 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-0d5dc58e-37f2-4e64-8cbe-e2eff369ca0c tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:57.814975 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-0d5dc58e-37f2-4e64-8cbe-e2eff369ca0c tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: 60bf3b10-9241-4fb1-9543-46147477634d] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:57.821227 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5fd46fa4-48c9-4700-b2a6-6b0644c7ebbe tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:57.822004 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-5fd46fa4-48c9-4700-b2a6-6b0644c7ebbe tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:57.828713 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5fd46fa4-48c9-4700-b2a6-6b0644c7ebbe tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:57.830746 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5fd46fa4-48c9-4700-b2a6-6b0644c7ebbe tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:57.831957 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5fd46fa4-48c9-4700-b2a6-6b0644c7ebbe tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:57.832586 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-0d5dc58e-37f2-4e64-8cbe-e2eff369ca0c tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:57.832795 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5fd46fa4-48c9-4700-b2a6-6b0644c7ebbe tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:57.833082 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-0d5dc58e-37f2-4e64-8cbe-e2eff369ca0c tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:57.833869 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-0d5dc58e-37f2-4e64-8cbe-e2eff369ca0c tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:57.834315 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-0d5dc58e-37f2-4e64-8cbe-e2eff369ca0c tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:57.863512 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:17:58.075254 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-5fd46fa4-48c9-4700-b2a6-6b0644c7ebbe tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:58.083884 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-5fd46fa4-48c9-4700-b2a6-6b0644c7ebbe tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:58.084300 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-0d5dc58e-37f2-4e64-8cbe-e2eff369ca0c tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:58.085957 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-5fd46fa4-48c9-4700-b2a6-6b0644c7ebbe tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:58.087136 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-5fd46fa4-48c9-4700-b2a6-6b0644c7ebbe tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1806 microversion: 2.20 time: 0.270046 Jul 28 18:17:58.089626 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 273/547] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:17:57 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1806 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:17:58.096118 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-0d5dc58e-37f2-4e64-8cbe-e2eff369ca0c tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d" status: 200 len: 1264 microversion: 2.1 time: 0.285664 Jul 28 18:17:58.109014 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 275/548] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:17:57 2022] GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d => generated 1264 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:17:59.113281 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f1d30ca7-f700-4aff-b8ef-a4da7e15db52 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:59.113890 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f1d30ca7-f700-4aff-b8ef-a4da7e15db52 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:59.121020 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-555bc7a0-6c69-47cc-9ffa-a0f8b879cf34 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:17:59.121519 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f1d30ca7-f700-4aff-b8ef-a4da7e15db52 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:59.121519 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f1d30ca7-f700-4aff-b8ef-a4da7e15db52 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:59.121733 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-555bc7a0-6c69-47cc-9ffa-a0f8b879cf34 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: 60bf3b10-9241-4fb1-9543-46147477634d] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:17:59.122255 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f1d30ca7-f700-4aff-b8ef-a4da7e15db52 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:59.122697 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f1d30ca7-f700-4aff-b8ef-a4da7e15db52 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:59.127910 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-555bc7a0-6c69-47cc-9ffa-a0f8b879cf34 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:59.128353 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-555bc7a0-6c69-47cc-9ffa-a0f8b879cf34 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:59.129138 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-555bc7a0-6c69-47cc-9ffa-a0f8b879cf34 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:17:59.129572 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-555bc7a0-6c69-47cc-9ffa-a0f8b879cf34 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:17:59.311631 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f1d30ca7-f700-4aff-b8ef-a4da7e15db52 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:59.320766 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f1d30ca7-f700-4aff-b8ef-a4da7e15db52 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:59.332224 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f1d30ca7-f700-4aff-b8ef-a4da7e15db52 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:59.333598 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f1d30ca7-f700-4aff-b8ef-a4da7e15db52 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1806 microversion: 2.20 time: 0.224577 Jul 28 18:17:59.334182 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 274/549] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:17:59 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1806 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:17:59.339387 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-555bc7a0-6c69-47cc-9ffa-a0f8b879cf34 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:17:59.354210 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-555bc7a0-6c69-47cc-9ffa-a0f8b879cf34 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d" status: 200 len: 1264 microversion: 2.1 time: 0.237030 Jul 28 18:17:59.364438 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 276/550] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:17:59 2022] GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d => generated 1264 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:18:00.356800 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ebe7c7f2-b503-4019-80cd-0e48e044552d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:00.357519 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ebe7c7f2-b503-4019-80cd-0e48e044552d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:00.363487 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ebe7c7f2-b503-4019-80cd-0e48e044552d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:00.363935 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ebe7c7f2-b503-4019-80cd-0e48e044552d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:00.364693 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ebe7c7f2-b503-4019-80cd-0e48e044552d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:00.365174 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ebe7c7f2-b503-4019-80cd-0e48e044552d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:00.375133 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-c05972dc-96df-4083-b029-cbb29f05da0e tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:00.375742 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-c05972dc-96df-4083-b029-cbb29f05da0e tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: 60bf3b10-9241-4fb1-9543-46147477634d] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:00.383003 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c05972dc-96df-4083-b029-cbb29f05da0e tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:00.383459 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c05972dc-96df-4083-b029-cbb29f05da0e tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:00.384236 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c05972dc-96df-4083-b029-cbb29f05da0e tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:00.384679 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c05972dc-96df-4083-b029-cbb29f05da0e tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:00.566819 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ebe7c7f2-b503-4019-80cd-0e48e044552d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:00.576131 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ebe7c7f2-b503-4019-80cd-0e48e044552d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:00.578001 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-c05972dc-96df-4083-b029-cbb29f05da0e tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:00.578154 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ebe7c7f2-b503-4019-80cd-0e48e044552d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:00.579477 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ebe7c7f2-b503-4019-80cd-0e48e044552d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1806 microversion: 2.20 time: 0.226724 Jul 28 18:18:00.580045 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 275/551] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:18:00 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1806 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:18:00.585687 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-c05972dc-96df-4083-b029-cbb29f05da0e tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d" status: 200 len: 1264 microversion: 2.1 time: 0.214459 Jul 28 18:18:00.586271 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 277/552] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:18:00 2022] GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d => generated 1264 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:18:01.606817 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-111987ad-b47b-4f97-b56d-71a6b174c487 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:01.607387 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-007d3e25-0c97-441d-80fb-d607c7bb9f8f tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:01.607771 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-111987ad-b47b-4f97-b56d-71a6b174c487 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:01.607888 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-007d3e25-0c97-441d-80fb-d607c7bb9f8f tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: 60bf3b10-9241-4fb1-9543-46147477634d] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:01.613761 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-111987ad-b47b-4f97-b56d-71a6b174c487 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:01.613975 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-007d3e25-0c97-441d-80fb-d607c7bb9f8f tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:01.614235 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-111987ad-b47b-4f97-b56d-71a6b174c487 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:01.614426 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-007d3e25-0c97-441d-80fb-d607c7bb9f8f tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:01.614992 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-111987ad-b47b-4f97-b56d-71a6b174c487 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:01.615203 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-007d3e25-0c97-441d-80fb-d607c7bb9f8f tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:01.615402 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-111987ad-b47b-4f97-b56d-71a6b174c487 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:01.615614 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-007d3e25-0c97-441d-80fb-d607c7bb9f8f tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:01.811534 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-007d3e25-0c97-441d-80fb-d607c7bb9f8f tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:01.819707 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-007d3e25-0c97-441d-80fb-d607c7bb9f8f tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d" status: 200 len: 1264 microversion: 2.1 time: 0.216284 Jul 28 18:18:01.823019 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-111987ad-b47b-4f97-b56d-71a6b174c487 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:01.828018 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 278/553] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:18:01 2022] GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d => generated 1264 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:18:01.831862 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-111987ad-b47b-4f97-b56d-71a6b174c487 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:01.833387 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-111987ad-b47b-4f97-b56d-71a6b174c487 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:01.834623 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-111987ad-b47b-4f97-b56d-71a6b174c487 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1806 microversion: 2.20 time: 0.232152 Jul 28 18:18:01.835169 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 276/554] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:18:01 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1806 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:18:02.148653 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-fca6b316-9d30-4317-9b4d-862b0033b189 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-262497862", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-182682276", "security_groups": [{"name": "tempest-secgroup-smoke-1389887105"}], "networks": [{"uuid": "ed7a3570-921e-426a-b0a5-d35c6a1b2b4d"}], "block_device_mapping_v2": [{"uuid": "8bc690c7-6317-4a54-8a49-14eec4f387cb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:18:02.270685 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.network.neutron [None req-fca6b316-9d30-4317-9b4d-862b0033b189 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] validate_networks() for [('ed7a3570-921e-426a-b0a5-d35c6a1b2b4d', None, None, None, None, None)] {{(pid=118454) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 18:18:02.690488 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.virt.hardware [None req-fca6b316-9d30-4317-9b4d-862b0033b189 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Flavor limits 0:0:0 {{(pid=118454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 18:18:02.691086 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.virt.hardware [None req-fca6b316-9d30-4317-9b4d-862b0033b189 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Image limits 0:0:0 {{(pid=118454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 18:18:02.691366 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.virt.hardware [None req-fca6b316-9d30-4317-9b4d-862b0033b189 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Flavor pref 0:0:0 {{(pid=118454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 18:18:02.691779 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.virt.hardware [None req-fca6b316-9d30-4317-9b4d-862b0033b189 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Image pref 0:0:0 {{(pid=118454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 18:18:02.692194 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.virt.hardware [None req-fca6b316-9d30-4317-9b4d-862b0033b189 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 18:18:02.701036 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-fca6b316-9d30-4317-9b4d-862b0033b189 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:02.701490 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-fca6b316-9d30-4317-9b4d-862b0033b189 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:02.702288 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-fca6b316-9d30-4317-9b4d-862b0033b189 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:02.702726 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-fca6b316-9d30-4317-9b4d-862b0033b189 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:02.721282 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.quota [None req-fca6b316-9d30-4317-9b4d-862b0033b189 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Getting quotas for project bf347b1959b247bcbe003ac3662cb239. Resources: {'cores', 'ram', 'instances'} {{(pid=118454) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 18:18:02.725675 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.quota [None req-fca6b316-9d30-4317-9b4d-862b0033b189 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Getting quotas for user 83ba025a383c433b900a3f4ae64959b3 and project bf347b1959b247bcbe003ac3662cb239. Resources: {'cores', 'ram', 'instances'} {{(pid=118454) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 18:18:02.781824 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-fca6b316-9d30-4317-9b4d-862b0033b189 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Going to run 1 instances... {{(pid=118454) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 18:18:02.783843 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-fca6b316-9d30-4317-9b4d-862b0033b189 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8bc690c7-6317-4a54-8a49-14eec4f387cb',volume_size=None,volume_type=None)] {{(pid=118454) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 18:18:02.840235 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0f07fbd6-a7a2-4350-a76e-4ae259a29dd3 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:02.841131 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0f07fbd6-a7a2-4350-a76e-4ae259a29dd3 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: 60bf3b10-9241-4fb1-9543-46147477634d] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:02.847161 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0f07fbd6-a7a2-4350-a76e-4ae259a29dd3 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:02.847617 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0f07fbd6-a7a2-4350-a76e-4ae259a29dd3 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:02.848383 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0f07fbd6-a7a2-4350-a76e-4ae259a29dd3 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:02.848828 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0f07fbd6-a7a2-4350-a76e-4ae259a29dd3 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:02.983893 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-0f07fbd6-a7a2-4350-a76e-4ae259a29dd3 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:02.991428 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0f07fbd6-a7a2-4350-a76e-4ae259a29dd3 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d" status: 200 len: 1264 microversion: 2.1 time: 0.155030 Jul 28 18:18:02.992019 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 277/555] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:18:02 2022] GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:18:03.001618 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-dbbed36f-9ebe-4b5f-81a1-0f9fd3d68474 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:03.002261 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-dbbed36f-9ebe-4b5f-81a1-0f9fd3d68474 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:03.008880 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dbbed36f-9ebe-4b5f-81a1-0f9fd3d68474 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:03.009355 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dbbed36f-9ebe-4b5f-81a1-0f9fd3d68474 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:03.010121 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dbbed36f-9ebe-4b5f-81a1-0f9fd3d68474 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:03.010558 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dbbed36f-9ebe-4b5f-81a1-0f9fd3d68474 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:03.138938 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-dbbed36f-9ebe-4b5f-81a1-0f9fd3d68474 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:03.147977 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-dbbed36f-9ebe-4b5f-81a1-0f9fd3d68474 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:03.149513 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-dbbed36f-9ebe-4b5f-81a1-0f9fd3d68474 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:03.150665 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-dbbed36f-9ebe-4b5f-81a1-0f9fd3d68474 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1806 microversion: 2.20 time: 0.157728 Jul 28 18:18:03.151221 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 278/556] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:18:02 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1806 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:18:03.170243 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-fca6b316-9d30-4317-9b4d-862b0033b189 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.025565 Jul 28 18:18:03.170885 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 279/557] 10.222.0.86 () {60 vars in 1147 bytes} [Thu Jul 28 18:18:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 1027 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 18:18:03.182239 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-c015decc-5db5-468d-9dc1-0273f786e2a1 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:03.182889 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-c015decc-5db5-468d-9dc1-0273f786e2a1 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:03.238222 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-c015decc-5db5-468d-9dc1-0273f786e2a1 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba025a383c433b900a3f4ae64959b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf347b1959b247bcbe003ac3662cb239', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:03.245920 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-c015decc-5db5-468d-9dc1-0273f786e2a1 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213" status: 200 len: 1087 microversion: 2.1 time: 0.067693 Jul 28 18:18:03.246488 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 279/558] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:18:03 2022] GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213 => generated 1087 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:18:04.012536 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-2d937c07-643b-436b-8ca3-eee233ff5a59 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:04.013352 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-2d937c07-643b-436b-8ca3-eee233ff5a59 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: 60bf3b10-9241-4fb1-9543-46147477634d] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:04.020531 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2d937c07-643b-436b-8ca3-eee233ff5a59 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:04.021159 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2d937c07-643b-436b-8ca3-eee233ff5a59 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:04.022526 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2d937c07-643b-436b-8ca3-eee233ff5a59 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:04.023046 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2d937c07-643b-436b-8ca3-eee233ff5a59 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:04.170250 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-2d937c07-643b-436b-8ca3-eee233ff5a59 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:04.173314 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b31b05dc-e766-441b-b10f-72f996e54e79 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:04.174446 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b31b05dc-e766-441b-b10f-72f996e54e79 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:04.180608 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b31b05dc-e766-441b-b10f-72f996e54e79 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:04.181090 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b31b05dc-e766-441b-b10f-72f996e54e79 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:04.182556 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b31b05dc-e766-441b-b10f-72f996e54e79 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:04.182942 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b31b05dc-e766-441b-b10f-72f996e54e79 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:04.187559 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-2d937c07-643b-436b-8ca3-eee233ff5a59 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d" status: 200 len: 1264 microversion: 2.1 time: 0.179516 Jul 28 18:18:04.188137 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 280/559] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:18:04 2022] GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d => generated 1264 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:18:04.267790 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-9c9102fb-4284-4835-8b51-337f1bbaf234 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:04.268443 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-9c9102fb-4284-4835-8b51-337f1bbaf234 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:04.351516 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b31b05dc-e766-441b-b10f-72f996e54e79 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:04.353619 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-9c9102fb-4284-4835-8b51-337f1bbaf234 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba025a383c433b900a3f4ae64959b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf347b1959b247bcbe003ac3662cb239', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:04.360269 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-9c9102fb-4284-4835-8b51-337f1bbaf234 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213" status: 200 len: 1087 microversion: 2.1 time: 0.096475 Jul 28 18:18:04.360690 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b31b05dc-e766-441b-b10f-72f996e54e79 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:04.360817 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 281/560] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:18:04 2022] GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213 => generated 1087 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:18:04.362345 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b31b05dc-e766-441b-b10f-72f996e54e79 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:04.364345 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b31b05dc-e766-441b-b10f-72f996e54e79 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1806 microversion: 2.20 time: 0.194857 Jul 28 18:18:04.365054 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 280/561] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:18:04 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1806 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:18:05.208520 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-66963100-2545-435d-97af-005dd611db28 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:05.209171 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-66963100-2545-435d-97af-005dd611db28 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: 60bf3b10-9241-4fb1-9543-46147477634d] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:05.217531 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-66963100-2545-435d-97af-005dd611db28 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:05.218006 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-66963100-2545-435d-97af-005dd611db28 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:05.218787 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-66963100-2545-435d-97af-005dd611db28 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:05.219287 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-66963100-2545-435d-97af-005dd611db28 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:05.359382 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-66963100-2545-435d-97af-005dd611db28 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:05.366826 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-66963100-2545-435d-97af-005dd611db28 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d" status: 200 len: 1264 microversion: 2.1 time: 0.162376 Jul 28 18:18:05.367536 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 282/562] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:18:05 2022] GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:18:05.383122 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-9b355897-585b-4014-ae5d-2eb5b667022d tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:05.384357 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-9b355897-585b-4014-ae5d-2eb5b667022d tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:05.387368 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-db09b46e-f22e-4097-9b81-00d4430151c6 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:05.388041 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-db09b46e-f22e-4097-9b81-00d4430151c6 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:05.391521 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9b355897-585b-4014-ae5d-2eb5b667022d tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:05.392356 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9b355897-585b-4014-ae5d-2eb5b667022d tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:05.393550 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9b355897-585b-4014-ae5d-2eb5b667022d tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:05.394391 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9b355897-585b-4014-ae5d-2eb5b667022d tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:05.395248 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-db09b46e-f22e-4097-9b81-00d4430151c6 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:05.395762 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-db09b46e-f22e-4097-9b81-00d4430151c6 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:05.396596 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-db09b46e-f22e-4097-9b81-00d4430151c6 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:05.397282 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-db09b46e-f22e-4097-9b81-00d4430151c6 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:05.423645 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell1:SELECT=100 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:18:05.495646 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-9b355897-585b-4014-ae5d-2eb5b667022d tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba025a383c433b900a3f4ae64959b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf347b1959b247bcbe003ac3662cb239', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:05.511821 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-9b355897-585b-4014-ae5d-2eb5b667022d tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213" status: 200 len: 1185 microversion: 2.1 time: 0.125174 Jul 28 18:18:05.511821 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 281/563] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:18:05 2022] GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213 => generated 1185 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:18:05.620631 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-db09b46e-f22e-4097-9b81-00d4430151c6 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:05.630031 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-db09b46e-f22e-4097-9b81-00d4430151c6 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:05.631586 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-db09b46e-f22e-4097-9b81-00d4430151c6 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:05.633309 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-db09b46e-f22e-4097-9b81-00d4430151c6 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1806 microversion: 2.20 time: 0.250488 Jul 28 18:18:05.634365 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 283/564] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:18:05 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1806 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:18:06.392815 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b59bb75d-fcea-4ca3-8e74-0adb8dddb517 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:06.393459 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b59bb75d-fcea-4ca3-8e74-0adb8dddb517 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: 60bf3b10-9241-4fb1-9543-46147477634d] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:06.405364 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b59bb75d-fcea-4ca3-8e74-0adb8dddb517 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:06.405828 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b59bb75d-fcea-4ca3-8e74-0adb8dddb517 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:06.406634 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b59bb75d-fcea-4ca3-8e74-0adb8dddb517 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:06.407071 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b59bb75d-fcea-4ca3-8e74-0adb8dddb517 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:06.525842 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-7043b6d2-00bb-4e19-981c-52b3ad47ec8b tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:06.526520 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-7043b6d2-00bb-4e19-981c-52b3ad47ec8b tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:06.530209 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:18:06.534128 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-7043b6d2-00bb-4e19-981c-52b3ad47ec8b tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:06.534770 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-7043b6d2-00bb-4e19-981c-52b3ad47ec8b tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:06.535736 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-7043b6d2-00bb-4e19-981c-52b3ad47ec8b tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:06.536337 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-7043b6d2-00bb-4e19-981c-52b3ad47ec8b tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:06.575279 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b59bb75d-fcea-4ca3-8e74-0adb8dddb517 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:06.585697 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b59bb75d-fcea-4ca3-8e74-0adb8dddb517 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d" status: 200 len: 1264 microversion: 2.1 time: 0.196698 Jul 28 18:18:06.586494 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 282/565] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:18:06 2022] GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d => generated 1264 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:18:06.655745 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-df58b261-1016-4182-8689-3e7769258161 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:06.656352 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-df58b261-1016-4182-8689-3e7769258161 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:06.662619 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-df58b261-1016-4182-8689-3e7769258161 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:06.663864 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-df58b261-1016-4182-8689-3e7769258161 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:06.664812 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-df58b261-1016-4182-8689-3e7769258161 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:06.665439 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-df58b261-1016-4182-8689-3e7769258161 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:06.699608 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-7043b6d2-00bb-4e19-981c-52b3ad47ec8b tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba025a383c433b900a3f4ae64959b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf347b1959b247bcbe003ac3662cb239', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:06.709517 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-7043b6d2-00bb-4e19-981c-52b3ad47ec8b tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213" status: 200 len: 1271 microversion: 2.1 time: 0.187466 Jul 28 18:18:06.712824 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 284/566] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:18:06 2022] GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213 => generated 1271 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:18:06.881269 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-df58b261-1016-4182-8689-3e7769258161 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:06.890256 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-df58b261-1016-4182-8689-3e7769258161 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:06.891834 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-df58b261-1016-4182-8689-3e7769258161 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:06.893098 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-df58b261-1016-4182-8689-3e7769258161 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1806 microversion: 2.20 time: 0.241173 Jul 28 18:18:06.893697 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 283/567] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:18:06 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1806 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:18:07.607942 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-97703bca-1a19-42f0-b929-a18ca8804c19 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:07.608650 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-97703bca-1a19-42f0-b929-a18ca8804c19 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: 60bf3b10-9241-4fb1-9543-46147477634d] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:07.619481 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-97703bca-1a19-42f0-b929-a18ca8804c19 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:07.620229 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-97703bca-1a19-42f0-b929-a18ca8804c19 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:07.621185 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-97703bca-1a19-42f0-b929-a18ca8804c19 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:07.621803 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-97703bca-1a19-42f0-b929-a18ca8804c19 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:07.752273 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-5aa1377f-5b18-4aaa-8a59-23e7c04daf72 req-c35de6b1-0f81-4bc5-b8fa-7046938dd6f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb0a115f-17bf-4501-af27-0802f70ac213", "tag": "5415e2f4-0f86-4921-bdc7-f0bf38bcd3e3"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:18:07.758206 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=60 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:18:07.763704 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-5aa1377f-5b18-4aaa-8a59-23e7c04daf72 req-c35de6b1-0f81-4bc5-b8fa-7046938dd6f5 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:07.764154 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-5aa1377f-5b18-4aaa-8a59-23e7c04daf72 req-c35de6b1-0f81-4bc5-b8fa-7046938dd6f5 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:07.777071 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-5aa1377f-5b18-4aaa-8a59-23e7c04daf72 req-c35de6b1-0f81-4bc5-b8fa-7046938dd6f5 service nova] Creating event network-changed:5415e2f4-0f86-4921-bdc7-f0bf38bcd3e3 for instance eb0a115f-17bf-4501-af27-0802f70ac213 on hv-cinder-84617 Jul 28 18:18:07.777974 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-97703bca-1a19-42f0-b929-a18ca8804c19 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:07.782818 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-5aa1377f-5b18-4aaa-8a59-23e7c04daf72 req-c35de6b1-0f81-4bc5-b8fa-7046938dd6f5 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.170955 Jul 28 18:18:07.783420 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 284/568] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:18:07.787311 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-97703bca-1a19-42f0-b929-a18ca8804c19 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d" status: 200 len: 1264 microversion: 2.1 time: 0.184481 Jul 28 18:18:07.791411 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 285/569] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:18:07 2022] GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d => generated 1264 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:18:07.792081 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-83e3a4bd-9b3d-4d82-817f-46ed3adba0c5 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:07.792081 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-83e3a4bd-9b3d-4d82-817f-46ed3adba0c5 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:07.796668 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-83e3a4bd-9b3d-4d82-817f-46ed3adba0c5 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:07.797164 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-83e3a4bd-9b3d-4d82-817f-46ed3adba0c5 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:07.797932 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-83e3a4bd-9b3d-4d82-817f-46ed3adba0c5 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:07.798397 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-83e3a4bd-9b3d-4d82-817f-46ed3adba0c5 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:07.916312 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-4662bd48-9487-4bba-a45e-9c7f37af43bc tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:07.917053 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-4662bd48-9487-4bba-a45e-9c7f37af43bc tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:07.923167 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-4662bd48-9487-4bba-a45e-9c7f37af43bc tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:07.923710 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-4662bd48-9487-4bba-a45e-9c7f37af43bc tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:07.924481 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-4662bd48-9487-4bba-a45e-9c7f37af43bc tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:07.924992 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-4662bd48-9487-4bba-a45e-9c7f37af43bc tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:07.934434 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-83e3a4bd-9b3d-4d82-817f-46ed3adba0c5 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba025a383c433b900a3f4ae64959b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf347b1959b247bcbe003ac3662cb239', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:07.942143 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-83e3a4bd-9b3d-4d82-817f-46ed3adba0c5 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213" status: 200 len: 1271 microversion: 2.1 time: 0.157390 Jul 28 18:18:07.942711 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 285/570] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:18:07 2022] GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213 => generated 1271 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:18:08.055042 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-4662bd48-9487-4bba-a45e-9c7f37af43bc tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:08.063494 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-4662bd48-9487-4bba-a45e-9c7f37af43bc tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:08.065037 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-4662bd48-9487-4bba-a45e-9c7f37af43bc tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:08.066188 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-4662bd48-9487-4bba-a45e-9c7f37af43bc tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1806 microversion: 2.20 time: 0.154080 Jul 28 18:18:08.066748 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 286/571] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:18:07 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1806 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:18:08.807751 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f10e3ac8-ce2a-4606-9bce-f80c99f81b4c tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:08.808298 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f10e3ac8-ce2a-4606-9bce-f80c99f81b4c tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: 60bf3b10-9241-4fb1-9543-46147477634d] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:08.814472 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f10e3ac8-ce2a-4606-9bce-f80c99f81b4c tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:08.814926 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f10e3ac8-ce2a-4606-9bce-f80c99f81b4c tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:08.815679 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f10e3ac8-ce2a-4606-9bce-f80c99f81b4c tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:08.816113 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f10e3ac8-ce2a-4606-9bce-f80c99f81b4c tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:08.948750 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f10e3ac8-ce2a-4606-9bce-f80c99f81b4c tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:08.956197 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f10e3ac8-ce2a-4606-9bce-f80c99f81b4c tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d" status: 200 len: 1264 microversion: 2.1 time: 0.152393 Jul 28 18:18:08.956769 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 286/572] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:18:08 2022] GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:18:08.963833 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-f3b4350c-9eb8-4918-b4b1-b4502e0a6935 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:08.964444 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-f3b4350c-9eb8-4918-b4b1-b4502e0a6935 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:08.971131 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f3b4350c-9eb8-4918-b4b1-b4502e0a6935 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:08.971579 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f3b4350c-9eb8-4918-b4b1-b4502e0a6935 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:08.972340 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f3b4350c-9eb8-4918-b4b1-b4502e0a6935 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:08.972777 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f3b4350c-9eb8-4918-b4b1-b4502e0a6935 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:09.090286 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-7b7df873-f44e-46be-b48a-e5e2465fe4ce tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:09.091154 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-7b7df873-f44e-46be-b48a-e5e2465fe4ce tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:09.097150 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7b7df873-f44e-46be-b48a-e5e2465fe4ce tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:09.097595 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7b7df873-f44e-46be-b48a-e5e2465fe4ce tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:09.098523 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7b7df873-f44e-46be-b48a-e5e2465fe4ce tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:09.098802 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7b7df873-f44e-46be-b48a-e5e2465fe4ce tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:09.100909 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-f3b4350c-9eb8-4918-b4b1-b4502e0a6935 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba025a383c433b900a3f4ae64959b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf347b1959b247bcbe003ac3662cb239', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:09.108375 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-f3b4350c-9eb8-4918-b4b1-b4502e0a6935 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213" status: 200 len: 1271 microversion: 2.1 time: 0.148821 Jul 28 18:18:09.108942 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 287/573] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:18:08 2022] GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213 => generated 1271 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:18:09.229952 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-7b7df873-f44e-46be-b48a-e5e2465fe4ce tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:09.238258 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-7b7df873-f44e-46be-b48a-e5e2465fe4ce tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:09.239767 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-7b7df873-f44e-46be-b48a-e5e2465fe4ce tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:09.241437 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-7b7df873-f44e-46be-b48a-e5e2465fe4ce tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1806 microversion: 2.20 time: 0.154683 Jul 28 18:18:09.242007 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 287/574] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:18:09 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1806 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:18:09.978187 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-1a5685a6-e900-40ab-8095-581d2d7a2ef9 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:09.978708 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-1a5685a6-e900-40ab-8095-581d2d7a2ef9 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: 60bf3b10-9241-4fb1-9543-46147477634d] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:09.985196 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-1a5685a6-e900-40ab-8095-581d2d7a2ef9 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:09.985649 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-1a5685a6-e900-40ab-8095-581d2d7a2ef9 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:09.986417 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-1a5685a6-e900-40ab-8095-581d2d7a2ef9 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:09.986860 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-1a5685a6-e900-40ab-8095-581d2d7a2ef9 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:10.121826 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-1a5685a6-e900-40ab-8095-581d2d7a2ef9 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:10.128882 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-63aa7587-873f-412c-872a-e04b9184018c tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:10.129437 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-1a5685a6-e900-40ab-8095-581d2d7a2ef9 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d" status: 200 len: 1264 microversion: 2.1 time: 0.155646 Jul 28 18:18:10.129562 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-63aa7587-873f-412c-872a-e04b9184018c tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:10.130098 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 288/575] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:18:09 2022] GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:18:10.135847 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-63aa7587-873f-412c-872a-e04b9184018c tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:10.136299 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-63aa7587-873f-412c-872a-e04b9184018c tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:10.137084 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-63aa7587-873f-412c-872a-e04b9184018c tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:10.137525 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-63aa7587-873f-412c-872a-e04b9184018c tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:10.264239 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-b5d0929f-a652-43d0-9985-cdd897c3122c tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:10.264859 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-b5d0929f-a652-43d0-9985-cdd897c3122c tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:10.265141 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-63aa7587-873f-412c-872a-e04b9184018c tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba025a383c433b900a3f4ae64959b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf347b1959b247bcbe003ac3662cb239', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:10.271775 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b5d0929f-a652-43d0-9985-cdd897c3122c tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:10.271972 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b5d0929f-a652-43d0-9985-cdd897c3122c tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:10.273665 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b5d0929f-a652-43d0-9985-cdd897c3122c tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:10.274053 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b5d0929f-a652-43d0-9985-cdd897c3122c tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:10.275713 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-63aa7587-873f-412c-872a-e04b9184018c tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213" status: 200 len: 1271 microversion: 2.1 time: 0.150327 Jul 28 18:18:10.276092 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 288/576] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:18:10 2022] GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213 => generated 1271 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:18:10.405933 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-b5d0929f-a652-43d0-9985-cdd897c3122c tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:10.414722 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-b5d0929f-a652-43d0-9985-cdd897c3122c tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:10.416234 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-b5d0929f-a652-43d0-9985-cdd897c3122c tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:10.417432 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-b5d0929f-a652-43d0-9985-cdd897c3122c tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1806 microversion: 2.20 time: 0.157648 Jul 28 18:18:10.417997 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 289/577] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:18:10 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1806 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:18:11.150564 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-6b912897-9085-4565-bb4e-6748e4f35cf1 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:11.151170 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-6b912897-9085-4565-bb4e-6748e4f35cf1 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: 60bf3b10-9241-4fb1-9543-46147477634d] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:11.157280 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6b912897-9085-4565-bb4e-6748e4f35cf1 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:11.157721 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6b912897-9085-4565-bb4e-6748e4f35cf1 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:11.158472 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6b912897-9085-4565-bb4e-6748e4f35cf1 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:11.158907 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6b912897-9085-4565-bb4e-6748e4f35cf1 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:11.286506 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-6b912897-9085-4565-bb4e-6748e4f35cf1 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:11.294667 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-6b912897-9085-4565-bb4e-6748e4f35cf1 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d" status: 200 len: 1264 microversion: 2.1 time: 0.147986 Jul 28 18:18:11.295232 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 289/578] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:18:11 2022] GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:18:11.296920 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-38831ab8-4a12-4ccc-8997-0b1aeb547044 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:11.297561 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-38831ab8-4a12-4ccc-8997-0b1aeb547044 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:11.304647 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-38831ab8-4a12-4ccc-8997-0b1aeb547044 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:11.305127 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-38831ab8-4a12-4ccc-8997-0b1aeb547044 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:11.305898 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-38831ab8-4a12-4ccc-8997-0b1aeb547044 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:11.306339 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-38831ab8-4a12-4ccc-8997-0b1aeb547044 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:11.440281 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-1c6d311f-44b2-466c-b118-5c004924ea95 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:11.440431 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-38831ab8-4a12-4ccc-8997-0b1aeb547044 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba025a383c433b900a3f4ae64959b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf347b1959b247bcbe003ac3662cb239', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:11.441277 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-1c6d311f-44b2-466c-b118-5c004924ea95 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:11.447575 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1c6d311f-44b2-466c-b118-5c004924ea95 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:11.448017 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1c6d311f-44b2-466c-b118-5c004924ea95 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:11.448576 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-38831ab8-4a12-4ccc-8997-0b1aeb547044 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213" status: 200 len: 1271 microversion: 2.1 time: 0.155477 Jul 28 18:18:11.449145 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1c6d311f-44b2-466c-b118-5c004924ea95 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:11.449273 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 290/579] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:18:11 2022] GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213 => generated 1271 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:18:11.449845 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1c6d311f-44b2-466c-b118-5c004924ea95 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:11.578298 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-1c6d311f-44b2-466c-b118-5c004924ea95 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:11.587282 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-1c6d311f-44b2-466c-b118-5c004924ea95 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:11.588817 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-1c6d311f-44b2-466c-b118-5c004924ea95 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:11.590000 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-1c6d311f-44b2-466c-b118-5c004924ea95 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1806 microversion: 2.20 time: 0.154098 Jul 28 18:18:11.590555 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 290/580] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:18:11 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1806 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:18:12.316114 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-a7b72c3c-72fb-4d39-97ad-04ac5da95b16 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:12.316743 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-a7b72c3c-72fb-4d39-97ad-04ac5da95b16 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: 60bf3b10-9241-4fb1-9543-46147477634d] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:12.323761 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a7b72c3c-72fb-4d39-97ad-04ac5da95b16 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:12.324205 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a7b72c3c-72fb-4d39-97ad-04ac5da95b16 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:12.324956 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a7b72c3c-72fb-4d39-97ad-04ac5da95b16 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:12.325417 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a7b72c3c-72fb-4d39-97ad-04ac5da95b16 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:12.453706 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-a7b72c3c-72fb-4d39-97ad-04ac5da95b16 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:12.462064 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-a7b72c3c-72fb-4d39-97ad-04ac5da95b16 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d" status: 200 len: 1264 microversion: 2.1 time: 0.149740 Jul 28 18:18:12.462657 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 291/581] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:18:12 2022] GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:18:12.469941 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3e1c375b-0594-4b2f-8067-28e5e1b0fb24 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:12.470582 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3e1c375b-0594-4b2f-8067-28e5e1b0fb24 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:12.478198 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3e1c375b-0594-4b2f-8067-28e5e1b0fb24 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:12.478840 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3e1c375b-0594-4b2f-8067-28e5e1b0fb24 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:12.479630 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3e1c375b-0594-4b2f-8067-28e5e1b0fb24 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:12.480301 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3e1c375b-0594-4b2f-8067-28e5e1b0fb24 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:12.611967 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-3e1c375b-0594-4b2f-8067-28e5e1b0fb24 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba025a383c433b900a3f4ae64959b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf347b1959b247bcbe003ac3662cb239', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:12.614443 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-ebd01bb3-97c1-40f1-9904-3398a873331e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:12.615058 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-ebd01bb3-97c1-40f1-9904-3398a873331e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:12.615590 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:18:12.620257 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-3e1c375b-0594-4b2f-8067-28e5e1b0fb24 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213" status: 200 len: 1271 microversion: 2.1 time: 0.154446 Jul 28 18:18:12.621110 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 291/582] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:18:12 2022] GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213 => generated 1271 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:18:12.625485 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ebd01bb3-97c1-40f1-9904-3398a873331e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:12.632766 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ebd01bb3-97c1-40f1-9904-3398a873331e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:12.632766 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ebd01bb3-97c1-40f1-9904-3398a873331e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:12.632766 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ebd01bb3-97c1-40f1-9904-3398a873331e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:12.710474 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell0:SELECT=2 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:18:12.755217 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-ebd01bb3-97c1-40f1-9904-3398a873331e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:12.764053 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-ebd01bb3-97c1-40f1-9904-3398a873331e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:12.765713 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-ebd01bb3-97c1-40f1-9904-3398a873331e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:12.766889 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-ebd01bb3-97c1-40f1-9904-3398a873331e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1806 microversion: 2.20 time: 0.156343 Jul 28 18:18:12.767551 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 292/583] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:18:12 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1806 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:18:13.487949 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-56ef3560-f5da-4339-82ec-86ea8c200ed1 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:13.488552 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-56ef3560-f5da-4339-82ec-86ea8c200ed1 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: 60bf3b10-9241-4fb1-9543-46147477634d] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:13.490416 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell0:SELECT=2 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:18:13.495958 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-56ef3560-f5da-4339-82ec-86ea8c200ed1 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:13.496401 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-56ef3560-f5da-4339-82ec-86ea8c200ed1 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:13.497185 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-56ef3560-f5da-4339-82ec-86ea8c200ed1 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:13.497617 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-56ef3560-f5da-4339-82ec-86ea8c200ed1 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:13.630315 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-56ef3560-f5da-4339-82ec-86ea8c200ed1 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:13.637831 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-56ef3560-f5da-4339-82ec-86ea8c200ed1 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d" status: 200 len: 1264 microversion: 2.1 time: 0.154282 Jul 28 18:18:13.638592 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 292/584] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:18:13 2022] GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:18:13.643462 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-446183a5-beb3-44c2-8462-16ce7eeb1ba8 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:13.644075 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-446183a5-beb3-44c2-8462-16ce7eeb1ba8 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:13.650623 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-446183a5-beb3-44c2-8462-16ce7eeb1ba8 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:13.651261 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-446183a5-beb3-44c2-8462-16ce7eeb1ba8 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:13.652022 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-446183a5-beb3-44c2-8462-16ce7eeb1ba8 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:13.652458 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-446183a5-beb3-44c2-8462-16ce7eeb1ba8 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:13.781263 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-446183a5-beb3-44c2-8462-16ce7eeb1ba8 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba025a383c433b900a3f4ae64959b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf347b1959b247bcbe003ac3662cb239', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:13.789576 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-446183a5-beb3-44c2-8462-16ce7eeb1ba8 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213" status: 200 len: 1271 microversion: 2.1 time: 0.149827 Jul 28 18:18:13.790160 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 293/585] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:18:13 2022] GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213 => generated 1271 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:18:13.791786 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-de0385a5-dba9-4b8d-a6a6-e39861df904e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:13.792399 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-de0385a5-dba9-4b8d-a6a6-e39861df904e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:13.798947 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-de0385a5-dba9-4b8d-a6a6-e39861df904e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:13.799398 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-de0385a5-dba9-4b8d-a6a6-e39861df904e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:13.800233 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-de0385a5-dba9-4b8d-a6a6-e39861df904e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:13.800701 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-de0385a5-dba9-4b8d-a6a6-e39861df904e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:14.018487 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-de0385a5-dba9-4b8d-a6a6-e39861df904e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:14.027826 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-de0385a5-dba9-4b8d-a6a6-e39861df904e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:14.029449 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-de0385a5-dba9-4b8d-a6a6-e39861df904e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:14.030773 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-de0385a5-dba9-4b8d-a6a6-e39861df904e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1806 microversion: 2.20 time: 0.244164 Jul 28 18:18:14.031332 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 293/586] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:18:13 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1806 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:18:14.658033 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-6068d0c9-757d-4b1a-995c-fd6501c3f9df tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:14.658770 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-6068d0c9-757d-4b1a-995c-fd6501c3f9df tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: 60bf3b10-9241-4fb1-9543-46147477634d] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:14.660772 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell0:SELECT=8 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:18:14.666809 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-6068d0c9-757d-4b1a-995c-fd6501c3f9df tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:14.667324 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-6068d0c9-757d-4b1a-995c-fd6501c3f9df tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:14.668109 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-6068d0c9-757d-4b1a-995c-fd6501c3f9df tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:14.668548 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-6068d0c9-757d-4b1a-995c-fd6501c3f9df tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:14.810782 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-8e06a0a9-026c-4173-833f-6851237bbe06 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:14.811760 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-8e06a0a9-026c-4173-833f-6851237bbe06 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:14.818108 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8e06a0a9-026c-4173-833f-6851237bbe06 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:14.818563 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8e06a0a9-026c-4173-833f-6851237bbe06 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:14.819978 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8e06a0a9-026c-4173-833f-6851237bbe06 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:14.820429 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8e06a0a9-026c-4173-833f-6851237bbe06 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:14.844851 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-6068d0c9-757d-4b1a-995c-fd6501c3f9df tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:14.853397 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-6068d0c9-757d-4b1a-995c-fd6501c3f9df tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d" status: 200 len: 1264 microversion: 2.1 time: 0.199438 Jul 28 18:18:14.853982 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 294/587] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:18:14 2022] GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d => generated 1264 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:18:14.949108 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8e06a0a9-026c-4173-833f-6851237bbe06 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba025a383c433b900a3f4ae64959b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf347b1959b247bcbe003ac3662cb239', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:14.956574 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-8e06a0a9-026c-4173-833f-6851237bbe06 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213" status: 200 len: 1259 microversion: 2.1 time: 0.149681 Jul 28 18:18:14.957543 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 294/588] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:18:14 2022] GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213 => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:18:15.055209 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-148c5a07-febc-48db-9257-87ccdedce8b8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:15.055814 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-148c5a07-febc-48db-9257-87ccdedce8b8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:15.062278 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-148c5a07-febc-48db-9257-87ccdedce8b8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:15.062761 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-148c5a07-febc-48db-9257-87ccdedce8b8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:15.063547 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-148c5a07-febc-48db-9257-87ccdedce8b8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:15.063940 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-148c5a07-febc-48db-9257-87ccdedce8b8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:15.194805 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-148c5a07-febc-48db-9257-87ccdedce8b8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:15.203205 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-148c5a07-febc-48db-9257-87ccdedce8b8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:15.204705 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-148c5a07-febc-48db-9257-87ccdedce8b8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:15.205892 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-148c5a07-febc-48db-9257-87ccdedce8b8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1806 microversion: 2.20 time: 0.155266 Jul 28 18:18:15.206456 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 295/589] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:18:15 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1806 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:18:15.873900 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-03551657-35c0-4706-9a53-5ed6bf7959e3 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:15.874511 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-03551657-35c0-4706-9a53-5ed6bf7959e3 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: 60bf3b10-9241-4fb1-9543-46147477634d] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:15.880581 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-03551657-35c0-4706-9a53-5ed6bf7959e3 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:15.881062 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-03551657-35c0-4706-9a53-5ed6bf7959e3 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:15.882342 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-03551657-35c0-4706-9a53-5ed6bf7959e3 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:15.882784 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-03551657-35c0-4706-9a53-5ed6bf7959e3 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:15.978280 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-4d8d9c1c-7136-47dc-ba5e-827a797be2a2 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:15.978913 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-4d8d9c1c-7136-47dc-ba5e-827a797be2a2 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:15.985433 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-4d8d9c1c-7136-47dc-ba5e-827a797be2a2 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:15.985891 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-4d8d9c1c-7136-47dc-ba5e-827a797be2a2 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:15.986663 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-4d8d9c1c-7136-47dc-ba5e-827a797be2a2 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:15.987101 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-4d8d9c1c-7136-47dc-ba5e-827a797be2a2 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:16.014150 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-03551657-35c0-4706-9a53-5ed6bf7959e3 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:16.021911 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-03551657-35c0-4706-9a53-5ed6bf7959e3 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d" status: 200 len: 1264 microversion: 2.1 time: 0.151807 Jul 28 18:18:16.022810 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 295/590] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:18:15 2022] GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:18:16.121093 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-4d8d9c1c-7136-47dc-ba5e-827a797be2a2 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba025a383c433b900a3f4ae64959b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf347b1959b247bcbe003ac3662cb239', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:16.128820 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-4d8d9c1c-7136-47dc-ba5e-827a797be2a2 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213" status: 200 len: 1259 microversion: 2.1 time: 0.154340 Jul 28 18:18:16.129622 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 296/591] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:18:15 2022] GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:18:16.230303 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-590851ed-40e2-46de-8e9b-7587c7053e3d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:16.230915 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-590851ed-40e2-46de-8e9b-7587c7053e3d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:16.236928 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-590851ed-40e2-46de-8e9b-7587c7053e3d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:16.237403 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-590851ed-40e2-46de-8e9b-7587c7053e3d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:16.238158 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-590851ed-40e2-46de-8e9b-7587c7053e3d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:16.238595 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-590851ed-40e2-46de-8e9b-7587c7053e3d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:16.448237 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-590851ed-40e2-46de-8e9b-7587c7053e3d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:16.455086 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-590851ed-40e2-46de-8e9b-7587c7053e3d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:16.456594 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-590851ed-40e2-46de-8e9b-7587c7053e3d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:16.457796 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-590851ed-40e2-46de-8e9b-7587c7053e3d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1806 microversion: 2.20 time: 0.232409 Jul 28 18:18:16.458355 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 296/592] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:18:16 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1806 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:18:17.042910 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-36f5d9f1-ed63-4dbe-bd6a-145ee70a15d6 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:17.043524 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-36f5d9f1-ed63-4dbe-bd6a-145ee70a15d6 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: 60bf3b10-9241-4fb1-9543-46147477634d] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:17.049998 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-36f5d9f1-ed63-4dbe-bd6a-145ee70a15d6 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:17.050447 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-36f5d9f1-ed63-4dbe-bd6a-145ee70a15d6 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:17.051215 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-36f5d9f1-ed63-4dbe-bd6a-145ee70a15d6 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:17.051657 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-36f5d9f1-ed63-4dbe-bd6a-145ee70a15d6 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:17.149739 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-19839677-6e8a-41f8-b19a-217822c4a696 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:17.150341 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-19839677-6e8a-41f8-b19a-217822c4a696 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:17.156320 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-19839677-6e8a-41f8-b19a-217822c4a696 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:17.156776 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-19839677-6e8a-41f8-b19a-217822c4a696 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:17.157581 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-19839677-6e8a-41f8-b19a-217822c4a696 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:17.158022 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-19839677-6e8a-41f8-b19a-217822c4a696 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:17.183286 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-36f5d9f1-ed63-4dbe-bd6a-145ee70a15d6 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:17.191363 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-36f5d9f1-ed63-4dbe-bd6a-145ee70a15d6 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d" status: 200 len: 1264 microversion: 2.1 time: 0.152347 Jul 28 18:18:17.191940 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 297/593] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:18:17 2022] GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:18:17.290788 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-19839677-6e8a-41f8-b19a-217822c4a696 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba025a383c433b900a3f4ae64959b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf347b1959b247bcbe003ac3662cb239', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:17.298192 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-19839677-6e8a-41f8-b19a-217822c4a696 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213" status: 200 len: 1259 microversion: 2.1 time: 0.152952 Jul 28 18:18:17.298759 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 297/594] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:18:17 2022] GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:18:17.482029 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-9332951a-d31b-4ce5-bf69-bc392f0dce76 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:17.482639 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-9332951a-d31b-4ce5-bf69-bc392f0dce76 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:17.488557 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-9332951a-d31b-4ce5-bf69-bc392f0dce76 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:17.489030 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-9332951a-d31b-4ce5-bf69-bc392f0dce76 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:17.489796 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-9332951a-d31b-4ce5-bf69-bc392f0dce76 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:17.490232 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-9332951a-d31b-4ce5-bf69-bc392f0dce76 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:17.619722 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-9332951a-d31b-4ce5-bf69-bc392f0dce76 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:17.628075 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-9332951a-d31b-4ce5-bf69-bc392f0dce76 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:17.629625 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-9332951a-d31b-4ce5-bf69-bc392f0dce76 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:17.630777 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-9332951a-d31b-4ce5-bf69-bc392f0dce76 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1806 microversion: 2.20 time: 0.152726 Jul 28 18:18:17.631330 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 298/595] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:18:17 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1806 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:18:18.212451 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-db46963f-482d-4724-ae69-61b641bb2c3d tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:18.213084 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-db46963f-482d-4724-ae69-61b641bb2c3d tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: 60bf3b10-9241-4fb1-9543-46147477634d] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:18.219390 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-db46963f-482d-4724-ae69-61b641bb2c3d tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:18.219836 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-db46963f-482d-4724-ae69-61b641bb2c3d tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:18.220603 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-db46963f-482d-4724-ae69-61b641bb2c3d tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:18.221063 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-db46963f-482d-4724-ae69-61b641bb2c3d tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:18.320203 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-57f1853f-c4ec-405a-ab6b-541fa52038c6 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:18.320957 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-57f1853f-c4ec-405a-ab6b-541fa52038c6 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:18.327447 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-57f1853f-c4ec-405a-ab6b-541fa52038c6 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:18.327893 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-57f1853f-c4ec-405a-ab6b-541fa52038c6 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:18.328649 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-57f1853f-c4ec-405a-ab6b-541fa52038c6 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:18.329110 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-57f1853f-c4ec-405a-ab6b-541fa52038c6 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:18.355421 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-db46963f-482d-4724-ae69-61b641bb2c3d tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:18.362959 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-db46963f-482d-4724-ae69-61b641bb2c3d tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d" status: 200 len: 1264 microversion: 2.1 time: 0.154946 Jul 28 18:18:18.363519 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 298/596] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:18:18 2022] GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:18:18.461461 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-57f1853f-c4ec-405a-ab6b-541fa52038c6 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba025a383c433b900a3f4ae64959b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf347b1959b247bcbe003ac3662cb239', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:18.469382 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-57f1853f-c4ec-405a-ab6b-541fa52038c6 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213" status: 200 len: 1259 microversion: 2.1 time: 0.153677 Jul 28 18:18:18.469894 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 299/597] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:18:18 2022] GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:18:18.654045 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-65e74c46-6b4f-422b-87b8-d8a145171d45 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:18.654659 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-65e74c46-6b4f-422b-87b8-d8a145171d45 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:18.660640 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-65e74c46-6b4f-422b-87b8-d8a145171d45 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:18.661136 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-65e74c46-6b4f-422b-87b8-d8a145171d45 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:18.661904 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-65e74c46-6b4f-422b-87b8-d8a145171d45 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:18.662345 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-65e74c46-6b4f-422b-87b8-d8a145171d45 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:18.799322 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-65e74c46-6b4f-422b-87b8-d8a145171d45 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:18.807905 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-65e74c46-6b4f-422b-87b8-d8a145171d45 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:18.809482 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-65e74c46-6b4f-422b-87b8-d8a145171d45 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:18.810639 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-65e74c46-6b4f-422b-87b8-d8a145171d45 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1806 microversion: 2.20 time: 0.160459 Jul 28 18:18:18.811201 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 299/598] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:18:18 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1806 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:18:19.384010 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-ca3f05cc-51da-4cb2-8fa6-7a225d8715c8 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:19.384621 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-ca3f05cc-51da-4cb2-8fa6-7a225d8715c8 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: 60bf3b10-9241-4fb1-9543-46147477634d] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:19.391194 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ca3f05cc-51da-4cb2-8fa6-7a225d8715c8 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:19.391645 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ca3f05cc-51da-4cb2-8fa6-7a225d8715c8 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:19.392401 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ca3f05cc-51da-4cb2-8fa6-7a225d8715c8 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:19.392838 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ca3f05cc-51da-4cb2-8fa6-7a225d8715c8 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:19.396738 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell1:SELECT=100 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:18:19.489838 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-6a4ab255-5a25-4575-9ba6-6e7e94c4fb25 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:19.490484 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-6a4ab255-5a25-4575-9ba6-6e7e94c4fb25 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:19.497104 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6a4ab255-5a25-4575-9ba6-6e7e94c4fb25 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:19.497557 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6a4ab255-5a25-4575-9ba6-6e7e94c4fb25 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:19.498341 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6a4ab255-5a25-4575-9ba6-6e7e94c4fb25 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:19.498779 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6a4ab255-5a25-4575-9ba6-6e7e94c4fb25 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:19.524029 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-ca3f05cc-51da-4cb2-8fa6-7a225d8715c8 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:19.531502 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-ca3f05cc-51da-4cb2-8fa6-7a225d8715c8 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d" status: 200 len: 1264 microversion: 2.1 time: 0.151264 Jul 28 18:18:19.532065 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 300/599] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:18:19 2022] GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:18:19.626905 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-6a4ab255-5a25-4575-9ba6-6e7e94c4fb25 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba025a383c433b900a3f4ae64959b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf347b1959b247bcbe003ac3662cb239', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:19.634399 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-6a4ab255-5a25-4575-9ba6-6e7e94c4fb25 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213" status: 200 len: 1259 microversion: 2.1 time: 0.148434 Jul 28 18:18:19.634962 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 300/600] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:18:19 2022] GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213 => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:18:19.833798 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-e77da2e0-309b-4045-8ba7-f04e6cd42013 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:19.834407 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-e77da2e0-309b-4045-8ba7-f04e6cd42013 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:19.841233 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e77da2e0-309b-4045-8ba7-f04e6cd42013 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:19.841728 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e77da2e0-309b-4045-8ba7-f04e6cd42013 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:19.842446 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e77da2e0-309b-4045-8ba7-f04e6cd42013 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:19.842883 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e77da2e0-309b-4045-8ba7-f04e6cd42013 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:19.988002 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-e77da2e0-309b-4045-8ba7-f04e6cd42013 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:19.996440 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-e77da2e0-309b-4045-8ba7-f04e6cd42013 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:19.997970 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-e77da2e0-309b-4045-8ba7-f04e6cd42013 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:19.999159 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-e77da2e0-309b-4045-8ba7-f04e6cd42013 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1806 microversion: 2.20 time: 0.169371 Jul 28 18:18:19.999720 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 301/601] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:18:19 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1806 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:18:20.551573 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-e095264e-3c77-4979-b66f-eb7bc4602460 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:20.552182 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-e095264e-3c77-4979-b66f-eb7bc4602460 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: 60bf3b10-9241-4fb1-9543-46147477634d] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:20.558154 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e095264e-3c77-4979-b66f-eb7bc4602460 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:20.558622 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e095264e-3c77-4979-b66f-eb7bc4602460 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:20.559359 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e095264e-3c77-4979-b66f-eb7bc4602460 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:20.559796 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e095264e-3c77-4979-b66f-eb7bc4602460 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:20.655070 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-c10e2d20-b6b2-45e7-a939-134e5a6259b9 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:20.655599 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-c10e2d20-b6b2-45e7-a939-134e5a6259b9 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:20.662285 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c10e2d20-b6b2-45e7-a939-134e5a6259b9 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:20.663591 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c10e2d20-b6b2-45e7-a939-134e5a6259b9 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:20.666245 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c10e2d20-b6b2-45e7-a939-134e5a6259b9 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:20.666245 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c10e2d20-b6b2-45e7-a939-134e5a6259b9 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:20.690224 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-e095264e-3c77-4979-b66f-eb7bc4602460 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:20.698046 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-e095264e-3c77-4979-b66f-eb7bc4602460 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d" status: 200 len: 1264 microversion: 2.1 time: 0.150262 Jul 28 18:18:20.698620 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 301/602] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:18:20 2022] GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:18:20.806287 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-c10e2d20-b6b2-45e7-a939-134e5a6259b9 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba025a383c433b900a3f4ae64959b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf347b1959b247bcbe003ac3662cb239', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:20.812688 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-c10e2d20-b6b2-45e7-a939-134e5a6259b9 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213" status: 200 len: 1259 microversion: 2.1 time: 0.161536 Jul 28 18:18:20.813279 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 302/603] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:18:20 2022] GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:18:21.022109 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ea88d651-9547-4ac4-9588-2d94d94f2ad5 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:21.023199 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ea88d651-9547-4ac4-9588-2d94d94f2ad5 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:21.029199 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ea88d651-9547-4ac4-9588-2d94d94f2ad5 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:21.029645 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ea88d651-9547-4ac4-9588-2d94d94f2ad5 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:21.030414 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ea88d651-9547-4ac4-9588-2d94d94f2ad5 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:21.030850 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ea88d651-9547-4ac4-9588-2d94d94f2ad5 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:21.160592 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ea88d651-9547-4ac4-9588-2d94d94f2ad5 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:21.169096 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ea88d651-9547-4ac4-9588-2d94d94f2ad5 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:21.170583 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ea88d651-9547-4ac4-9588-2d94d94f2ad5 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:21.171720 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ea88d651-9547-4ac4-9588-2d94d94f2ad5 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1806 microversion: 2.20 time: 0.153652 Jul 28 18:18:21.172272 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 302/604] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:18:21 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1806 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:18:21.719479 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-68134440-e028-4dbb-8c1f-8b67e3b1743c tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:21.720013 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-68134440-e028-4dbb-8c1f-8b67e3b1743c tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: 60bf3b10-9241-4fb1-9543-46147477634d] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:21.727038 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-68134440-e028-4dbb-8c1f-8b67e3b1743c tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:21.727484 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-68134440-e028-4dbb-8c1f-8b67e3b1743c tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:21.728245 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-68134440-e028-4dbb-8c1f-8b67e3b1743c tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:21.728680 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-68134440-e028-4dbb-8c1f-8b67e3b1743c tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:21.832780 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-27e98326-6fd8-4803-80f1-6eda18020b82 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:21.833427 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-27e98326-6fd8-4803-80f1-6eda18020b82 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:21.840107 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-27e98326-6fd8-4803-80f1-6eda18020b82 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:21.840558 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-27e98326-6fd8-4803-80f1-6eda18020b82 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:21.841617 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-27e98326-6fd8-4803-80f1-6eda18020b82 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:21.842054 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-27e98326-6fd8-4803-80f1-6eda18020b82 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:21.865393 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-68134440-e028-4dbb-8c1f-8b67e3b1743c tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:21.873624 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-68134440-e028-4dbb-8c1f-8b67e3b1743c tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d" status: 200 len: 1264 microversion: 2.1 time: 0.158600 Jul 28 18:18:21.874192 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 303/605] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:18:21 2022] GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:18:21.969628 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-27e98326-6fd8-4803-80f1-6eda18020b82 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba025a383c433b900a3f4ae64959b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf347b1959b247bcbe003ac3662cb239', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:21.977503 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-27e98326-6fd8-4803-80f1-6eda18020b82 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213" status: 200 len: 1259 microversion: 2.1 time: 0.148595 Jul 28 18:18:21.978065 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 303/606] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:18:21 2022] GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213 => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:18:22.194677 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-c25320e2-bee5-4a90-8bee-a2fe9c2a17da tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:22.195288 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-c25320e2-bee5-4a90-8bee-a2fe9c2a17da tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:22.201261 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c25320e2-bee5-4a90-8bee-a2fe9c2a17da tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:22.201713 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c25320e2-bee5-4a90-8bee-a2fe9c2a17da tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:22.202486 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c25320e2-bee5-4a90-8bee-a2fe9c2a17da tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:22.202925 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c25320e2-bee5-4a90-8bee-a2fe9c2a17da tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:22.329524 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-c25320e2-bee5-4a90-8bee-a2fe9c2a17da tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:22.338376 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-c25320e2-bee5-4a90-8bee-a2fe9c2a17da tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:22.339903 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-c25320e2-bee5-4a90-8bee-a2fe9c2a17da tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:22.341358 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-c25320e2-bee5-4a90-8bee-a2fe9c2a17da tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1806 microversion: 2.20 time: 0.150688 Jul 28 18:18:22.341914 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 304/607] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:18:22 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1806 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:18:22.776682 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-cc1cfcf1-d8c8-4716-b7e2-19d1ae8973f5 req-785afcba-7535-493b-afa0-06b410228207 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60bf3b10-9241-4fb1-9543-46147477634d", "name": "network-vif-plugged", "status": "completed", "tag": "c9c5491c-fa11-47ad-bc68-d27692005b9b"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:18:22.786188 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-cc1cfcf1-d8c8-4716-b7e2-19d1ae8973f5 req-785afcba-7535-493b-afa0-06b410228207 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:22.786638 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-cc1cfcf1-d8c8-4716-b7e2-19d1ae8973f5 req-785afcba-7535-493b-afa0-06b410228207 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:22.798582 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-cc1cfcf1-d8c8-4716-b7e2-19d1ae8973f5 req-785afcba-7535-493b-afa0-06b410228207 service nova] Creating event network-vif-plugged:c9c5491c-fa11-47ad-bc68-d27692005b9b for instance 60bf3b10-9241-4fb1-9543-46147477634d on hv-cinder-84617 Jul 28 18:18:22.804822 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-cc1cfcf1-d8c8-4716-b7e2-19d1ae8973f5 req-785afcba-7535-493b-afa0-06b410228207 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087004 Jul 28 18:18:22.805050 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 304/608] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:18:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:18:22.894842 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-6016f43f-3198-4f94-b9ca-75cda327e840 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:22.895454 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-6016f43f-3198-4f94-b9ca-75cda327e840 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: 60bf3b10-9241-4fb1-9543-46147477634d] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:22.902463 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-6016f43f-3198-4f94-b9ca-75cda327e840 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:22.905131 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-6016f43f-3198-4f94-b9ca-75cda327e840 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:22.905131 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-6016f43f-3198-4f94-b9ca-75cda327e840 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:22.905131 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-6016f43f-3198-4f94-b9ca-75cda327e840 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:22.998545 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-cd5efccc-a85a-40ca-aa7b-5cf9712f946a tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:22.999328 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-cd5efccc-a85a-40ca-aa7b-5cf9712f946a tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:23.005771 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cd5efccc-a85a-40ca-aa7b-5cf9712f946a tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:23.006292 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cd5efccc-a85a-40ca-aa7b-5cf9712f946a tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:23.007692 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cd5efccc-a85a-40ca-aa7b-5cf9712f946a tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:23.008136 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cd5efccc-a85a-40ca-aa7b-5cf9712f946a tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:23.047556 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-6016f43f-3198-4f94-b9ca-75cda327e840 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:23.055984 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-6016f43f-3198-4f94-b9ca-75cda327e840 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d" status: 200 len: 1264 microversion: 2.1 time: 0.165433 Jul 28 18:18:23.056650 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 305/609] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:18:22 2022] GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:18:23.148740 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-cd5efccc-a85a-40ca-aa7b-5cf9712f946a tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba025a383c433b900a3f4ae64959b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf347b1959b247bcbe003ac3662cb239', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:23.156213 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-cd5efccc-a85a-40ca-aa7b-5cf9712f946a tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213" status: 200 len: 1259 microversion: 2.1 time: 0.161824 Jul 28 18:18:23.156778 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 305/610] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:18:22 2022] GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:18:23.365081 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-4871bedf-5086-4779-bfa5-6fd28e5225d1 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:23.365695 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-4871bedf-5086-4779-bfa5-6fd28e5225d1 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:23.372443 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-4871bedf-5086-4779-bfa5-6fd28e5225d1 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:23.372839 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-4871bedf-5086-4779-bfa5-6fd28e5225d1 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:23.373710 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-4871bedf-5086-4779-bfa5-6fd28e5225d1 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:23.374153 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-4871bedf-5086-4779-bfa5-6fd28e5225d1 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:23.502944 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-4871bedf-5086-4779-bfa5-6fd28e5225d1 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:23.511242 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-4871bedf-5086-4779-bfa5-6fd28e5225d1 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:23.512760 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-4871bedf-5086-4779-bfa5-6fd28e5225d1 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:23.513942 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-4871bedf-5086-4779-bfa5-6fd28e5225d1 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1806 microversion: 2.20 time: 0.152836 Jul 28 18:18:23.514499 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 306/611] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:18:23 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1806 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:18:24.077433 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-47dc0ebd-cae4-49db-8841-71e9c6347a6b tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:24.078035 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-47dc0ebd-cae4-49db-8841-71e9c6347a6b tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: 60bf3b10-9241-4fb1-9543-46147477634d] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:24.084122 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-47dc0ebd-cae4-49db-8841-71e9c6347a6b tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:24.084571 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-47dc0ebd-cae4-49db-8841-71e9c6347a6b tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:24.085971 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-47dc0ebd-cae4-49db-8841-71e9c6347a6b tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:24.086405 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-47dc0ebd-cae4-49db-8841-71e9c6347a6b tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:24.177363 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-8c61307d-70fe-452d-ab72-e257db2680de tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:24.177974 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-8c61307d-70fe-452d-ab72-e257db2680de tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:24.184057 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-8c61307d-70fe-452d-ab72-e257db2680de tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:24.184502 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-8c61307d-70fe-452d-ab72-e257db2680de tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:24.185286 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-8c61307d-70fe-452d-ab72-e257db2680de tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:24.185722 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-8c61307d-70fe-452d-ab72-e257db2680de tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:24.216353 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-47dc0ebd-cae4-49db-8841-71e9c6347a6b tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:24.223938 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-47dc0ebd-cae4-49db-8841-71e9c6347a6b tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d" status: 200 len: 1264 microversion: 2.1 time: 0.150325 Jul 28 18:18:24.224504 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 306/612] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:18:24 2022] GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:18:24.316138 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-8c61307d-70fe-452d-ab72-e257db2680de tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba025a383c433b900a3f4ae64959b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf347b1959b247bcbe003ac3662cb239', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:24.324514 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-8c61307d-70fe-452d-ab72-e257db2680de tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213" status: 200 len: 1259 microversion: 2.1 time: 0.151135 Jul 28 18:18:24.325104 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 307/613] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:18:24 2022] GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:18:24.537045 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-02965207-47a7-436b-8b02-2b3e9293937e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:24.537648 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-02965207-47a7-436b-8b02-2b3e9293937e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:24.543717 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-02965207-47a7-436b-8b02-2b3e9293937e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:24.544167 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-02965207-47a7-436b-8b02-2b3e9293937e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:24.544924 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-02965207-47a7-436b-8b02-2b3e9293937e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:24.545387 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-02965207-47a7-436b-8b02-2b3e9293937e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:24.676912 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-02965207-47a7-436b-8b02-2b3e9293937e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:24.686029 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-02965207-47a7-436b-8b02-2b3e9293937e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:24.687531 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-02965207-47a7-436b-8b02-2b3e9293937e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:24.688688 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-02965207-47a7-436b-8b02-2b3e9293937e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1806 microversion: 2.20 time: 0.155634 Jul 28 18:18:24.689339 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 307/614] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:18:24 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1806 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:18:24.820606 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [req-c46ad64c-a5cf-4203-a092-23bfd4684643 req-3d029be2-00fa-4bed-a862-5ebf6bd46505 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b1c63c9-4f4b-4c9e-91da-42f88fd63286", "name": "network-vif-plugged", "status": "completed", "tag": "1d258458-0cee-481c-93c4-bf0b858d9e28"}]} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:18:24.830455 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-c46ad64c-a5cf-4203-a092-23bfd4684643 req-3d029be2-00fa-4bed-a862-5ebf6bd46505 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:24.830893 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-c46ad64c-a5cf-4203-a092-23bfd4684643 req-3d029be2-00fa-4bed-a862-5ebf6bd46505 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:24.842715 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.compute.server_external_events [req-c46ad64c-a5cf-4203-a092-23bfd4684643 req-3d029be2-00fa-4bed-a862-5ebf6bd46505 service nova] Creating event network-vif-plugged:1d258458-0cee-481c-93c4-bf0b858d9e28 for instance 2b1c63c9-4f4b-4c9e-91da-42f88fd63286 on hv-cinder-84617 Jul 28 18:18:24.852817 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [req-c46ad64c-a5cf-4203-a092-23bfd4684643 req-3d029be2-00fa-4bed-a862-5ebf6bd46505 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030952 Jul 28 18:18:24.852817 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 308/615] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:18:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:18:25.243773 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-54914fef-d304-4223-819f-5196ab15221f tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:25.244374 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-54914fef-d304-4223-819f-5196ab15221f tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: 60bf3b10-9241-4fb1-9543-46147477634d] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:25.250356 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-54914fef-d304-4223-819f-5196ab15221f tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:25.250805 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-54914fef-d304-4223-819f-5196ab15221f tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:25.251572 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-54914fef-d304-4223-819f-5196ab15221f tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:25.252011 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-54914fef-d304-4223-819f-5196ab15221f tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:25.346640 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-5377ff76-83d5-4165-87b1-f8a79dc08067 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:25.347338 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-5377ff76-83d5-4165-87b1-f8a79dc08067 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:25.354699 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-5377ff76-83d5-4165-87b1-f8a79dc08067 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:25.355267 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-5377ff76-83d5-4165-87b1-f8a79dc08067 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:25.356045 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-5377ff76-83d5-4165-87b1-f8a79dc08067 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:25.356489 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-5377ff76-83d5-4165-87b1-f8a79dc08067 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:25.383197 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-54914fef-d304-4223-819f-5196ab15221f tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:25.390718 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-54914fef-d304-4223-819f-5196ab15221f tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d" status: 200 len: 1264 microversion: 2.1 time: 0.150768 Jul 28 18:18:25.391287 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 308/616] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:18:25 2022] GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:18:25.491326 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-5377ff76-83d5-4165-87b1-f8a79dc08067 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba025a383c433b900a3f4ae64959b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf347b1959b247bcbe003ac3662cb239', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:25.498921 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-5377ff76-83d5-4165-87b1-f8a79dc08067 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213" status: 200 len: 1259 microversion: 2.1 time: 0.156969 Jul 28 18:18:25.499482 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 309/617] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:18:25 2022] GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:18:25.713558 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-6696e80f-758a-47ee-a410-d862bd4f1fe6 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:25.714169 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-6696e80f-758a-47ee-a410-d862bd4f1fe6 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:25.720295 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6696e80f-758a-47ee-a410-d862bd4f1fe6 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:25.720745 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6696e80f-758a-47ee-a410-d862bd4f1fe6 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:25.721596 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6696e80f-758a-47ee-a410-d862bd4f1fe6 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:25.722036 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6696e80f-758a-47ee-a410-d862bd4f1fe6 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:25.726214 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:18:25.873657 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-6696e80f-758a-47ee-a410-d862bd4f1fe6 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:25.882705 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-6696e80f-758a-47ee-a410-d862bd4f1fe6 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:25.884216 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-6696e80f-758a-47ee-a410-d862bd4f1fe6 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:25.885432 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-6696e80f-758a-47ee-a410-d862bd4f1fe6 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1806 microversion: 2.20 time: 0.176913 Jul 28 18:18:25.885996 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 309/618] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:18:25 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1806 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:18:26.411554 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-7d42ed79-c371-4f0f-8fe0-0442450a8da5 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:26.412190 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-7d42ed79-c371-4f0f-8fe0-0442450a8da5 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: 60bf3b10-9241-4fb1-9543-46147477634d] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:26.419893 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-7d42ed79-c371-4f0f-8fe0-0442450a8da5 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:26.420350 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-7d42ed79-c371-4f0f-8fe0-0442450a8da5 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:26.421633 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-7d42ed79-c371-4f0f-8fe0-0442450a8da5 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:26.422084 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-7d42ed79-c371-4f0f-8fe0-0442450a8da5 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:26.520143 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-fd9fdf7f-d819-4d05-87bb-c31a3a22fdec tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:26.520731 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-fd9fdf7f-d819-4d05-87bb-c31a3a22fdec tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:26.527533 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fd9fdf7f-d819-4d05-87bb-c31a3a22fdec tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:26.527976 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fd9fdf7f-d819-4d05-87bb-c31a3a22fdec tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:26.528739 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fd9fdf7f-d819-4d05-87bb-c31a3a22fdec tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:26.529291 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fd9fdf7f-d819-4d05-87bb-c31a3a22fdec tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:26.558561 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-7d42ed79-c371-4f0f-8fe0-0442450a8da5 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:26.566796 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-7d42ed79-c371-4f0f-8fe0-0442450a8da5 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d" status: 200 len: 1264 microversion: 2.1 time: 0.159067 Jul 28 18:18:26.569305 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 310/619] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:18:26 2022] GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:18:26.669324 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-fd9fdf7f-d819-4d05-87bb-c31a3a22fdec tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba025a383c433b900a3f4ae64959b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf347b1959b247bcbe003ac3662cb239', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:26.677142 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-fd9fdf7f-d819-4d05-87bb-c31a3a22fdec tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213" status: 200 len: 1259 microversion: 2.1 time: 0.161353 Jul 28 18:18:26.677712 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 310/620] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:18:26 2022] GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:18:26.907944 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-76c9e348-9b26-40a5-bb8b-3f832949c2d2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:26.908553 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-76c9e348-9b26-40a5-bb8b-3f832949c2d2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:26.914543 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-76c9e348-9b26-40a5-bb8b-3f832949c2d2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:26.914996 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-76c9e348-9b26-40a5-bb8b-3f832949c2d2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:26.915790 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-76c9e348-9b26-40a5-bb8b-3f832949c2d2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:26.916233 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-76c9e348-9b26-40a5-bb8b-3f832949c2d2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:27.048787 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-76c9e348-9b26-40a5-bb8b-3f832949c2d2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:27.057447 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-76c9e348-9b26-40a5-bb8b-3f832949c2d2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:27.058955 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-76c9e348-9b26-40a5-bb8b-3f832949c2d2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:27.060128 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-76c9e348-9b26-40a5-bb8b-3f832949c2d2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1806 microversion: 2.20 time: 0.156168 Jul 28 18:18:27.060698 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 311/621] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:18:26 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1806 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:18:27.587812 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-7bfcaf0b-6705-434a-b767-9de08b448857 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:27.588424 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-7bfcaf0b-6705-434a-b767-9de08b448857 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: 60bf3b10-9241-4fb1-9543-46147477634d] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:27.594921 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7bfcaf0b-6705-434a-b767-9de08b448857 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:27.595372 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7bfcaf0b-6705-434a-b767-9de08b448857 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:27.596143 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7bfcaf0b-6705-434a-b767-9de08b448857 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:27.596587 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7bfcaf0b-6705-434a-b767-9de08b448857 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:27.711315 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-d9fd07b9-358f-4420-bc39-6b0765e35033 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:27.711926 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-d9fd07b9-358f-4420-bc39-6b0765e35033 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:27.718665 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d9fd07b9-358f-4420-bc39-6b0765e35033 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:27.719112 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d9fd07b9-358f-4420-bc39-6b0765e35033 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:27.719899 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d9fd07b9-358f-4420-bc39-6b0765e35033 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:27.720337 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d9fd07b9-358f-4420-bc39-6b0765e35033 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:27.727707 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-7bfcaf0b-6705-434a-b767-9de08b448857 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:27.735167 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-7bfcaf0b-6705-434a-b767-9de08b448857 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d" status: 200 len: 1264 microversion: 2.1 time: 0.151329 Jul 28 18:18:27.735733 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 311/622] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:18:27 2022] GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:18:27.859191 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-d9fd07b9-358f-4420-bc39-6b0765e35033 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba025a383c433b900a3f4ae64959b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf347b1959b247bcbe003ac3662cb239', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:27.867530 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-d9fd07b9-358f-4420-bc39-6b0765e35033 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213" status: 200 len: 1259 microversion: 2.1 time: 0.159964 Jul 28 18:18:27.868118 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 312/623] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:18:27 2022] GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:18:28.083606 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d674d59b-1ba3-4ead-a7d5-a66c68eeda91 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:28.084168 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-d674d59b-1ba3-4ead-a7d5-a66c68eeda91 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:28.091054 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d674d59b-1ba3-4ead-a7d5-a66c68eeda91 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:28.091556 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d674d59b-1ba3-4ead-a7d5-a66c68eeda91 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:28.092405 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d674d59b-1ba3-4ead-a7d5-a66c68eeda91 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:28.092847 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d674d59b-1ba3-4ead-a7d5-a66c68eeda91 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:28.223363 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-d674d59b-1ba3-4ead-a7d5-a66c68eeda91 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:28.232422 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-d674d59b-1ba3-4ead-a7d5-a66c68eeda91 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:28.234032 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-d674d59b-1ba3-4ead-a7d5-a66c68eeda91 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:28.235179 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-d674d59b-1ba3-4ead-a7d5-a66c68eeda91 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1806 microversion: 2.20 time: 0.155720 Jul 28 18:18:28.235744 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 312/624] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:18:28 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1806 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:18:28.759275 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-2593ba83-fc25-443a-94ae-3ecd17fedf92 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:28.759275 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-2593ba83-fc25-443a-94ae-3ecd17fedf92 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: 60bf3b10-9241-4fb1-9543-46147477634d] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:28.763513 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2593ba83-fc25-443a-94ae-3ecd17fedf92 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:28.763964 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2593ba83-fc25-443a-94ae-3ecd17fedf92 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:28.764727 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2593ba83-fc25-443a-94ae-3ecd17fedf92 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:28.765193 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2593ba83-fc25-443a-94ae-3ecd17fedf92 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:28.888872 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-6b8b32bf-8e5f-4b84-aa97-059b598b13f3 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:28.889580 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-6b8b32bf-8e5f-4b84-aa97-059b598b13f3 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:28.895829 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6b8b32bf-8e5f-4b84-aa97-059b598b13f3 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:28.896270 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6b8b32bf-8e5f-4b84-aa97-059b598b13f3 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:28.897064 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6b8b32bf-8e5f-4b84-aa97-059b598b13f3 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:28.897593 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6b8b32bf-8e5f-4b84-aa97-059b598b13f3 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:28.917021 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-2593ba83-fc25-443a-94ae-3ecd17fedf92 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:28.924568 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-2593ba83-fc25-443a-94ae-3ecd17fedf92 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d" status: 200 len: 1264 microversion: 2.1 time: 0.172648 Jul 28 18:18:28.925217 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 313/625] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:18:28 2022] GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d => generated 1264 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:18:29.058057 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-6b8b32bf-8e5f-4b84-aa97-059b598b13f3 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba025a383c433b900a3f4ae64959b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf347b1959b247bcbe003ac3662cb239', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:29.067718 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-6b8b32bf-8e5f-4b84-aa97-059b598b13f3 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213" status: 200 len: 1259 microversion: 2.1 time: 0.183170 Jul 28 18:18:29.068293 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 313/626] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:18:28 2022] GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213 => generated 1259 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:18:29.258173 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-90b21803-9231-4071-a70d-ae07ffe87bc0 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:29.258782 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-90b21803-9231-4071-a70d-ae07ffe87bc0 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:29.264822 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-90b21803-9231-4071-a70d-ae07ffe87bc0 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:29.265789 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-90b21803-9231-4071-a70d-ae07ffe87bc0 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:29.266073 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-90b21803-9231-4071-a70d-ae07ffe87bc0 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:29.266590 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-90b21803-9231-4071-a70d-ae07ffe87bc0 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:29.400189 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-90b21803-9231-4071-a70d-ae07ffe87bc0 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:29.408658 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-90b21803-9231-4071-a70d-ae07ffe87bc0 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:29.422644 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-90b21803-9231-4071-a70d-ae07ffe87bc0 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:29.422644 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-90b21803-9231-4071-a70d-ae07ffe87bc0 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1806 microversion: 2.20 time: 0.157194 Jul 28 18:18:29.422644 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 314/627] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:18:29 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1806 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:18:29.946348 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-7d45a748-3748-4a43-b238-67eb12bb27bc tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:29.946933 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-7d45a748-3748-4a43-b238-67eb12bb27bc tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: 60bf3b10-9241-4fb1-9543-46147477634d] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:29.953012 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7d45a748-3748-4a43-b238-67eb12bb27bc tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:29.953462 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7d45a748-3748-4a43-b238-67eb12bb27bc tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:29.954245 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7d45a748-3748-4a43-b238-67eb12bb27bc tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:29.954682 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7d45a748-3748-4a43-b238-67eb12bb27bc tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:30.082838 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-7d45a748-3748-4a43-b238-67eb12bb27bc tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:30.089681 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-1d98970c-5ac4-4eba-b1e9-1b42c9d338ce tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:30.090371 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-1d98970c-5ac4-4eba-b1e9-1b42c9d338ce tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:30.091324 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-7d45a748-3748-4a43-b238-67eb12bb27bc tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d" status: 200 len: 1451 microversion: 2.1 time: 0.149289 Jul 28 18:18:30.091893 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 314/628] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:18:29 2022] GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:18:30.097353 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-1d98970c-5ac4-4eba-b1e9-1b42c9d338ce tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:30.097800 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-1d98970c-5ac4-4eba-b1e9-1b42c9d338ce tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:30.098553 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-1d98970c-5ac4-4eba-b1e9-1b42c9d338ce tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:30.098993 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-1d98970c-5ac4-4eba-b1e9-1b42c9d338ce tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:30.111569 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3979ab1e-2890-4754-93ca-d6b40ae85710 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:30.112184 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3979ab1e-2890-4754-93ca-d6b40ae85710 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: 60bf3b10-9241-4fb1-9543-46147477634d] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:30.118476 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3979ab1e-2890-4754-93ca-d6b40ae85710 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:30.118932 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3979ab1e-2890-4754-93ca-d6b40ae85710 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:30.119887 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3979ab1e-2890-4754-93ca-d6b40ae85710 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:30.120217 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3979ab1e-2890-4754-93ca-d6b40ae85710 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:30.302853 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-1d98970c-5ac4-4eba-b1e9-1b42c9d338ce tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba025a383c433b900a3f4ae64959b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf347b1959b247bcbe003ac3662cb239', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:30.313614 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-1d98970c-5ac4-4eba-b1e9-1b42c9d338ce tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213" status: 200 len: 1259 microversion: 2.1 time: 0.228198 Jul 28 18:18:30.315465 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 315/629] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:18:30 2022] GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213 => generated 1259 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:18:30.318189 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-3979ab1e-2890-4754-93ca-d6b40ae85710 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:30.327215 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-3979ab1e-2890-4754-93ca-d6b40ae85710 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d" status: 200 len: 1451 microversion: 2.1 time: 0.219342 Jul 28 18:18:30.327798 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 315/630] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:18:30 2022] GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d => generated 1451 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:18:30.435305 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-0c41c43c-b517-4849-868f-ef69acb021c3 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:30.435919 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-0c41c43c-b517-4849-868f-ef69acb021c3 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:30.442098 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-0c41c43c-b517-4849-868f-ef69acb021c3 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:30.442545 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-0c41c43c-b517-4849-868f-ef69acb021c3 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:30.443348 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-0c41c43c-b517-4849-868f-ef69acb021c3 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:30.443924 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-0c41c43c-b517-4849-868f-ef69acb021c3 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:30.581253 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-0c41c43c-b517-4849-868f-ef69acb021c3 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:30.589778 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-0c41c43c-b517-4849-868f-ef69acb021c3 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:30.591554 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-0c41c43c-b517-4849-868f-ef69acb021c3 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:30.592718 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-0c41c43c-b517-4849-868f-ef69acb021c3 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1806 microversion: 2.20 time: 0.161533 Jul 28 18:18:30.593476 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 316/631] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:18:30 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1806 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:18:31.337019 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3e8ad49f-4eca-4b0e-8b50-ad136a584a66 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:31.337634 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3e8ad49f-4eca-4b0e-8b50-ad136a584a66 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:31.344057 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3e8ad49f-4eca-4b0e-8b50-ad136a584a66 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:31.344510 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3e8ad49f-4eca-4b0e-8b50-ad136a584a66 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:31.345313 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3e8ad49f-4eca-4b0e-8b50-ad136a584a66 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:31.345790 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3e8ad49f-4eca-4b0e-8b50-ad136a584a66 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:31.495117 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-3e8ad49f-4eca-4b0e-8b50-ad136a584a66 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba025a383c433b900a3f4ae64959b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf347b1959b247bcbe003ac3662cb239', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:31.504087 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-3e8ad49f-4eca-4b0e-8b50-ad136a584a66 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213" status: 200 len: 1259 microversion: 2.1 time: 0.171439 Jul 28 18:18:31.505173 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 316/632] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:18:31 2022] GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213 => generated 1259 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:18:31.622300 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-c96cadff-0da6-4bf5-9436-f50aec1104b6 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:31.622300 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-c96cadff-0da6-4bf5-9436-f50aec1104b6 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:31.628242 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c96cadff-0da6-4bf5-9436-f50aec1104b6 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:31.628938 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c96cadff-0da6-4bf5-9436-f50aec1104b6 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:31.629839 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c96cadff-0da6-4bf5-9436-f50aec1104b6 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:31.631109 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c96cadff-0da6-4bf5-9436-f50aec1104b6 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:31.654356 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell1:SELECT=100 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:18:31.771976 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-c96cadff-0da6-4bf5-9436-f50aec1104b6 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:31.780479 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-c96cadff-0da6-4bf5-9436-f50aec1104b6 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:31.783223 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-c96cadff-0da6-4bf5-9436-f50aec1104b6 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:31.783223 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-c96cadff-0da6-4bf5-9436-f50aec1104b6 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1806 microversion: 2.20 time: 0.170463 Jul 28 18:18:31.783725 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 317/633] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:18:31 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1806 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:18:32.545242 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-8fc9a224-c96a-4682-9b30-7dd8f1ac5d66 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:32.545865 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-8fc9a224-c96a-4682-9b30-7dd8f1ac5d66 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:32.554050 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8fc9a224-c96a-4682-9b30-7dd8f1ac5d66 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:32.554826 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8fc9a224-c96a-4682-9b30-7dd8f1ac5d66 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:32.556731 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8fc9a224-c96a-4682-9b30-7dd8f1ac5d66 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:32.557370 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8fc9a224-c96a-4682-9b30-7dd8f1ac5d66 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:32.834084 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8fc9a224-c96a-4682-9b30-7dd8f1ac5d66 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba025a383c433b900a3f4ae64959b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf347b1959b247bcbe003ac3662cb239', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:32.856535 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-8fc9a224-c96a-4682-9b30-7dd8f1ac5d66 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213" status: 200 len: 1259 microversion: 2.1 time: 0.320381 Jul 28 18:18:32.856535 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 317/634] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:18:32 2022] GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213 => generated 1259 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:18:32.878433 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-fa03b1b4-aa07-4ec3-a971-59b2a214d5d0 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:32.880935 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-fa03b1b4-aa07-4ec3-a971-59b2a214d5d0 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:32.893116 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [req-e2522610-7854-4c20-bded-e9261d32e505 req-c46a4adc-7259-462c-9dbc-47eabd49bf5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60bf3b10-9241-4fb1-9543-46147477634d", "tag": "c9c5491c-fa11-47ad-bc68-d27692005b9b"}]} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:18:32.898800 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fa03b1b4-aa07-4ec3-a971-59b2a214d5d0 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:32.899359 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fa03b1b4-aa07-4ec3-a971-59b2a214d5d0 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:32.900045 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fa03b1b4-aa07-4ec3-a971-59b2a214d5d0 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:32.900653 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fa03b1b4-aa07-4ec3-a971-59b2a214d5d0 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:32.907464 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-e2522610-7854-4c20-bded-e9261d32e505 req-c46a4adc-7259-462c-9dbc-47eabd49bf5c service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:32.908010 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-e2522610-7854-4c20-bded-e9261d32e505 req-c46a4adc-7259-462c-9dbc-47eabd49bf5c service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:32.922119 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.compute.server_external_events [req-e2522610-7854-4c20-bded-e9261d32e505 req-c46a4adc-7259-462c-9dbc-47eabd49bf5c service nova] Creating event network-changed:c9c5491c-fa11-47ad-bc68-d27692005b9b for instance 60bf3b10-9241-4fb1-9543-46147477634d on hv-cinder-84617 Jul 28 18:18:32.931243 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [req-e2522610-7854-4c20-bded-e9261d32e505 req-c46a4adc-7259-462c-9dbc-47eabd49bf5c service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.212619 Jul 28 18:18:32.933654 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 318/635] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:18:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 18:18:33.090272 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-fa03b1b4-aa07-4ec3-a971-59b2a214d5d0 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:33.111043 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-fa03b1b4-aa07-4ec3-a971-59b2a214d5d0 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:33.114375 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-fa03b1b4-aa07-4ec3-a971-59b2a214d5d0 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:33.117108 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-fa03b1b4-aa07-4ec3-a971-59b2a214d5d0 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1806 microversion: 2.20 time: 0.261536 Jul 28 18:18:33.118477 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 318/636] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:18:32 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1806 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:18:33.667333 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [req-ab6e2758-42f3-47f8-94d8-80d0ce79de56 req-b0816e29-f32c-4088-830e-4a25b6d63faa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb0a115f-17bf-4501-af27-0802f70ac213", "name": "network-vif-plugged", "status": "completed", "tag": "5415e2f4-0f86-4921-bdc7-f0bf38bcd3e3"}]} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:18:33.677683 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-ab6e2758-42f3-47f8-94d8-80d0ce79de56 req-b0816e29-f32c-4088-830e-4a25b6d63faa service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:33.678273 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-ab6e2758-42f3-47f8-94d8-80d0ce79de56 req-b0816e29-f32c-4088-830e-4a25b6d63faa service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:33.690610 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.compute.server_external_events [req-ab6e2758-42f3-47f8-94d8-80d0ce79de56 req-b0816e29-f32c-4088-830e-4a25b6d63faa service nova] Creating event network-vif-plugged:5415e2f4-0f86-4921-bdc7-f0bf38bcd3e3 for instance eb0a115f-17bf-4501-af27-0802f70ac213 on hv-cinder-84617 Jul 28 18:18:33.696693 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [req-ab6e2758-42f3-47f8-94d8-80d0ce79de56 req-b0816e29-f32c-4088-830e-4a25b6d63faa service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034430 Jul 28 18:18:33.697474 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 319/637] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:18:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 18:18:33.872118 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ed6556c2-2977-4fe3-8b6a-0493495f390b tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:33.875275 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ed6556c2-2977-4fe3-8b6a-0493495f390b tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:33.879899 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ed6556c2-2977-4fe3-8b6a-0493495f390b tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:33.880350 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ed6556c2-2977-4fe3-8b6a-0493495f390b tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:33.881166 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ed6556c2-2977-4fe3-8b6a-0493495f390b tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:33.882137 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ed6556c2-2977-4fe3-8b6a-0493495f390b tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:34.020048 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ed6556c2-2977-4fe3-8b6a-0493495f390b tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba025a383c433b900a3f4ae64959b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf347b1959b247bcbe003ac3662cb239', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:34.027641 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ed6556c2-2977-4fe3-8b6a-0493495f390b tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213" status: 200 len: 1259 microversion: 2.1 time: 0.160004 Jul 28 18:18:34.028211 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 319/638] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:18:33 2022] GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:18:34.141810 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-dec4b919-5c03-4108-88c4-d12960d4a818 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:34.142415 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-dec4b919-5c03-4108-88c4-d12960d4a818 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:34.148474 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-dec4b919-5c03-4108-88c4-d12960d4a818 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:34.148915 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-dec4b919-5c03-4108-88c4-d12960d4a818 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:34.149704 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-dec4b919-5c03-4108-88c4-d12960d4a818 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:34.150134 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-dec4b919-5c03-4108-88c4-d12960d4a818 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:34.285814 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-dec4b919-5c03-4108-88c4-d12960d4a818 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:34.294165 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-dec4b919-5c03-4108-88c4-d12960d4a818 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:34.295673 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-dec4b919-5c03-4108-88c4-d12960d4a818 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:34.296842 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-dec4b919-5c03-4108-88c4-d12960d4a818 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1793 microversion: 2.20 time: 0.159980 Jul 28 18:18:34.297427 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 320/639] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:18:34 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1793 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:18:35.048528 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-acef8e75-bb2f-4c0c-ae84-b5c20745fdd6 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:35.049194 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-acef8e75-bb2f-4c0c-ae84-b5c20745fdd6 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:35.055416 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-acef8e75-bb2f-4c0c-ae84-b5c20745fdd6 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:35.055888 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-acef8e75-bb2f-4c0c-ae84-b5c20745fdd6 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:35.056657 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-acef8e75-bb2f-4c0c-ae84-b5c20745fdd6 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:35.057128 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-acef8e75-bb2f-4c0c-ae84-b5c20745fdd6 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:35.186054 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-acef8e75-bb2f-4c0c-ae84-b5c20745fdd6 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba025a383c433b900a3f4ae64959b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf347b1959b247bcbe003ac3662cb239', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:35.193588 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-acef8e75-bb2f-4c0c-ae84-b5c20745fdd6 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213" status: 200 len: 1259 microversion: 2.1 time: 0.148939 Jul 28 18:18:35.194644 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 320/640] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:18:35 2022] GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213 => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:18:36.214842 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-74ae475f-3409-4db8-a9d1-cafc46c13b60 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:36.215453 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-74ae475f-3409-4db8-a9d1-cafc46c13b60 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:36.222804 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-74ae475f-3409-4db8-a9d1-cafc46c13b60 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:36.223253 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-74ae475f-3409-4db8-a9d1-cafc46c13b60 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:36.224038 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-74ae475f-3409-4db8-a9d1-cafc46c13b60 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:36.224589 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-74ae475f-3409-4db8-a9d1-cafc46c13b60 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:36.357808 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-74ae475f-3409-4db8-a9d1-cafc46c13b60 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba025a383c433b900a3f4ae64959b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf347b1959b247bcbe003ac3662cb239', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:36.365391 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-74ae475f-3409-4db8-a9d1-cafc46c13b60 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213" status: 200 len: 1443 microversion: 2.1 time: 0.154425 Jul 28 18:18:36.365958 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 321/641] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:18:36 2022] GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213 => generated 1443 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:18:36.386764 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-8b182e50-c3ae-4f49-8e80-7b2d8dedb830 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:36.387377 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-8b182e50-c3ae-4f49-8e80-7b2d8dedb830 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:36.393415 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8b182e50-c3ae-4f49-8e80-7b2d8dedb830 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:36.393871 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8b182e50-c3ae-4f49-8e80-7b2d8dedb830 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:36.394636 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8b182e50-c3ae-4f49-8e80-7b2d8dedb830 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:36.395077 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8b182e50-c3ae-4f49-8e80-7b2d8dedb830 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:36.526293 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8b182e50-c3ae-4f49-8e80-7b2d8dedb830 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba025a383c433b900a3f4ae64959b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf347b1959b247bcbe003ac3662cb239', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:36.533679 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-8b182e50-c3ae-4f49-8e80-7b2d8dedb830 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213" status: 200 len: 1443 microversion: 2.1 time: 0.151491 Jul 28 18:18:36.534240 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 321/642] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:18:36 2022] GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213 => generated 1443 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:18:38.543456 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [req-4e2d31f9-e898-49e9-810a-adce77b6d21e req-befdbd75-4759-4648-832f-fde3b10d1620 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb0a115f-17bf-4501-af27-0802f70ac213", "tag": "5415e2f4-0f86-4921-bdc7-f0bf38bcd3e3"}]} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:18:38.550465 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_api:SELECT=76 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:18:38.554325 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-4e2d31f9-e898-49e9-810a-adce77b6d21e req-befdbd75-4759-4648-832f-fde3b10d1620 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:38.554784 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-4e2d31f9-e898-49e9-810a-adce77b6d21e req-befdbd75-4759-4648-832f-fde3b10d1620 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:38.566302 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.compute.server_external_events [req-4e2d31f9-e898-49e9-810a-adce77b6d21e req-befdbd75-4759-4648-832f-fde3b10d1620 service nova] Creating event network-changed:5415e2f4-0f86-4921-bdc7-f0bf38bcd3e3 for instance eb0a115f-17bf-4501-af27-0802f70ac213 on hv-cinder-84617 Jul 28 18:18:38.572213 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [req-4e2d31f9-e898-49e9-810a-adce77b6d21e req-befdbd75-4759-4648-832f-fde3b10d1620 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032592 Jul 28 18:18:38.572807 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 322/643] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:18:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:18:40.098683 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-663b506c-5951-4161-bbb8-94f7b42b991c tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5f35737c-241c-4033-938c-f0a90723fbba"}} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:18:40.101095 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-663b506c-5951-4161-bbb8-94f7b42b991c tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 39af8515-9818-4664-9e32-7a8a318f02c6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:40.103524 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=76 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:18:40.108274 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-663b506c-5951-4161-bbb8-94f7b42b991c tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:40.108756 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-663b506c-5951-4161-bbb8-94f7b42b991c tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:40.109550 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-663b506c-5951-4161-bbb8-94f7b42b991c tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:40.109989 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-663b506c-5951-4161-bbb8-94f7b42b991c tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:40.824187 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-663b506c-5951-4161-bbb8-94f7b42b991c tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "POST /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.889530 Jul 28 18:18:40.824795 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 322/644] 10.222.0.86 () {60 vars in 1323 bytes} [Thu Jul 28 18:18:39 2022] POST /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6/os-volume_attachments => generated 194 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:18:49.403196 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-f0866c08-9c02-4dd5-9aaf-8bda142ead2d tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:18:49.405510 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-f0866c08-9c02-4dd5-9aaf-8bda142ead2d tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 39af8515-9818-4664-9e32-7a8a318f02c6] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:49.408609 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell1:SELECT=20 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:18:49.413771 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f0866c08-9c02-4dd5-9aaf-8bda142ead2d tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:49.414218 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f0866c08-9c02-4dd5-9aaf-8bda142ead2d tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:49.415005 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f0866c08-9c02-4dd5-9aaf-8bda142ead2d tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:49.415451 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f0866c08-9c02-4dd5-9aaf-8bda142ead2d tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:49.438935 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.objects.instance [None req-f0866c08-9c02-4dd5-9aaf-8bda142ead2d tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lazy-loading 'flavor' on Instance uuid 39af8515-9818-4664-9e32-7a8a318f02c6 {{(pid=118454) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:18:49.698206 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-f0866c08-9c02-4dd5-9aaf-8bda142ead2d tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "POST /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6/action" status: 200 len: 32 microversion: 2.1 time: 0.299857 Jul 28 18:18:49.698770 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 323/645] 10.222.0.86 () {60 vars in 1278 bytes} [Thu Jul 28 18:18:49 2022] POST /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6/action => generated 32 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 18:18:49.709611 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-bdbe4a11-a869-4436-ad73-b1735669b7d1 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:49.710299 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-bdbe4a11-a869-4436-ad73-b1735669b7d1 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 39af8515-9818-4664-9e32-7a8a318f02c6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:49.717505 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bdbe4a11-a869-4436-ad73-b1735669b7d1 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:49.717951 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bdbe4a11-a869-4436-ad73-b1735669b7d1 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:49.724348 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bdbe4a11-a869-4436-ad73-b1735669b7d1 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:49.724348 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bdbe4a11-a869-4436-ad73-b1735669b7d1 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:49.853872 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-bdbe4a11-a869-4436-ad73-b1735669b7d1 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:49.861909 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-bdbe4a11-a869-4436-ad73-b1735669b7d1 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6" status: 200 len: 1736 microversion: 2.1 time: 0.157266 Jul 28 18:18:49.862485 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 323/646] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:18:49 2022] GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:18:50.883481 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-a0920cd5-6275-496f-8d9f-86d3e4947d65 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:50.884419 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-a0920cd5-6275-496f-8d9f-86d3e4947d65 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 39af8515-9818-4664-9e32-7a8a318f02c6] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:50.890830 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a0920cd5-6275-496f-8d9f-86d3e4947d65 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:50.891281 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a0920cd5-6275-496f-8d9f-86d3e4947d65 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:50.892047 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a0920cd5-6275-496f-8d9f-86d3e4947d65 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:50.892483 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a0920cd5-6275-496f-8d9f-86d3e4947d65 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:51.023214 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-a0920cd5-6275-496f-8d9f-86d3e4947d65 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:51.031502 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-a0920cd5-6275-496f-8d9f-86d3e4947d65 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6" status: 200 len: 1736 microversion: 2.1 time: 0.152728 Jul 28 18:18:51.032062 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 324/647] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:18:50 2022] GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:18:52.052990 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-8fe2641e-bf1c-42ea-9ca5-fcc66d49f3b6 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:52.053638 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-8fe2641e-bf1c-42ea-9ca5-fcc66d49f3b6 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 39af8515-9818-4664-9e32-7a8a318f02c6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:52.060165 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8fe2641e-bf1c-42ea-9ca5-fcc66d49f3b6 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:52.060613 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8fe2641e-bf1c-42ea-9ca5-fcc66d49f3b6 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:52.061389 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8fe2641e-bf1c-42ea-9ca5-fcc66d49f3b6 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:52.061829 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8fe2641e-bf1c-42ea-9ca5-fcc66d49f3b6 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:52.079170 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:18:52.189416 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8fe2641e-bf1c-42ea-9ca5-fcc66d49f3b6 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:52.197786 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-8fe2641e-bf1c-42ea-9ca5-fcc66d49f3b6 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6" status: 200 len: 1736 microversion: 2.1 time: 0.148662 Jul 28 18:18:52.198345 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 324/648] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:18:52 2022] GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:18:53.219372 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-a2244687-d81d-4571-bb1a-b042bee0d4b5 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:53.219977 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-a2244687-d81d-4571-bb1a-b042bee0d4b5 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 39af8515-9818-4664-9e32-7a8a318f02c6] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:53.226547 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a2244687-d81d-4571-bb1a-b042bee0d4b5 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:53.227020 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a2244687-d81d-4571-bb1a-b042bee0d4b5 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:53.227902 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a2244687-d81d-4571-bb1a-b042bee0d4b5 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:53.228349 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a2244687-d81d-4571-bb1a-b042bee0d4b5 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:53.359387 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-a2244687-d81d-4571-bb1a-b042bee0d4b5 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:53.367250 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-a2244687-d81d-4571-bb1a-b042bee0d4b5 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6" status: 200 len: 1736 microversion: 2.1 time: 0.152007 Jul 28 18:18:53.367805 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 325/649] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:18:53 2022] GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:18:54.388879 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a27f480c-8068-4261-869a-4b7f50f2eb85 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:54.389546 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-a27f480c-8068-4261-869a-4b7f50f2eb85 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 39af8515-9818-4664-9e32-7a8a318f02c6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:54.396095 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a27f480c-8068-4261-869a-4b7f50f2eb85 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:54.396533 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a27f480c-8068-4261-869a-4b7f50f2eb85 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:54.397318 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a27f480c-8068-4261-869a-4b7f50f2eb85 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:54.397793 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a27f480c-8068-4261-869a-4b7f50f2eb85 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:54.525748 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-a27f480c-8068-4261-869a-4b7f50f2eb85 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:54.533672 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-a27f480c-8068-4261-869a-4b7f50f2eb85 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6" status: 200 len: 1736 microversion: 2.1 time: 0.148880 Jul 28 18:18:54.534234 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 325/650] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:18:54 2022] GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:18:55.554770 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-bfbba0b8-face-48f8-93a8-474d46e14fed tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:55.555373 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-bfbba0b8-face-48f8-93a8-474d46e14fed tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 39af8515-9818-4664-9e32-7a8a318f02c6] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:55.561439 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-bfbba0b8-face-48f8-93a8-474d46e14fed tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:55.561880 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-bfbba0b8-face-48f8-93a8-474d46e14fed tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:55.562634 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-bfbba0b8-face-48f8-93a8-474d46e14fed tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:55.563066 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-bfbba0b8-face-48f8-93a8-474d46e14fed tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:55.689292 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-bfbba0b8-face-48f8-93a8-474d46e14fed tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:55.697831 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-bfbba0b8-face-48f8-93a8-474d46e14fed tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6" status: 200 len: 1736 microversion: 2.1 time: 0.146955 Jul 28 18:18:55.698392 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 326/651] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:18:55 2022] GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:18:56.719869 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-314f216b-d23f-43df-816e-c6640179a5b1 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:56.720473 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-314f216b-d23f-43df-816e-c6640179a5b1 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 39af8515-9818-4664-9e32-7a8a318f02c6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:56.726878 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-314f216b-d23f-43df-816e-c6640179a5b1 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:56.727329 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-314f216b-d23f-43df-816e-c6640179a5b1 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:56.728758 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-314f216b-d23f-43df-816e-c6640179a5b1 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:56.729230 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-314f216b-d23f-43df-816e-c6640179a5b1 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:56.870067 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-314f216b-d23f-43df-816e-c6640179a5b1 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:56.878223 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-314f216b-d23f-43df-816e-c6640179a5b1 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6" status: 200 len: 1736 microversion: 2.1 time: 0.162544 Jul 28 18:18:56.878796 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 326/652] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:18:56 2022] GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:18:57.898742 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-24a799b4-a37f-4136-980e-c3305295eabc tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:57.899337 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-24a799b4-a37f-4136-980e-c3305295eabc tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 39af8515-9818-4664-9e32-7a8a318f02c6] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:57.906413 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-24a799b4-a37f-4136-980e-c3305295eabc tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:57.906875 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-24a799b4-a37f-4136-980e-c3305295eabc tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:57.907630 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-24a799b4-a37f-4136-980e-c3305295eabc tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:57.908067 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-24a799b4-a37f-4136-980e-c3305295eabc tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:58.036679 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-24a799b4-a37f-4136-980e-c3305295eabc tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:58.043569 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-24a799b4-a37f-4136-980e-c3305295eabc tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6" status: 200 len: 1736 microversion: 2.1 time: 0.148710 Jul 28 18:18:58.044182 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 327/653] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:18:57 2022] GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:18:59.065047 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-31f9cd09-ec99-4fbf-9023-1edb512473bc tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:18:59.065635 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-31f9cd09-ec99-4fbf-9023-1edb512473bc tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 39af8515-9818-4664-9e32-7a8a318f02c6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:18:59.072283 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-31f9cd09-ec99-4fbf-9023-1edb512473bc tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:59.072737 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-31f9cd09-ec99-4fbf-9023-1edb512473bc tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:59.073527 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-31f9cd09-ec99-4fbf-9023-1edb512473bc tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:18:59.073966 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-31f9cd09-ec99-4fbf-9023-1edb512473bc tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:18:59.210960 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-31f9cd09-ec99-4fbf-9023-1edb512473bc tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:18:59.219982 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-31f9cd09-ec99-4fbf-9023-1edb512473bc tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6" status: 200 len: 1736 microversion: 2.1 time: 0.158788 Jul 28 18:18:59.220554 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 327/654] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:18:59 2022] GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:19:00.241544 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-ae73a248-f4ef-4d37-a2bb-8069c6c8dff8 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:19:00.242209 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-ae73a248-f4ef-4d37-a2bb-8069c6c8dff8 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 39af8515-9818-4664-9e32-7a8a318f02c6] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:19:00.249418 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ae73a248-f4ef-4d37-a2bb-8069c6c8dff8 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:00.249877 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ae73a248-f4ef-4d37-a2bb-8069c6c8dff8 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:00.250666 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ae73a248-f4ef-4d37-a2bb-8069c6c8dff8 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:00.251100 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ae73a248-f4ef-4d37-a2bb-8069c6c8dff8 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:00.379267 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-ae73a248-f4ef-4d37-a2bb-8069c6c8dff8 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:19:00.387786 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-ae73a248-f4ef-4d37-a2bb-8069c6c8dff8 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6" status: 200 len: 1736 microversion: 2.1 time: 0.150195 Jul 28 18:19:00.388354 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 328/655] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:19:00 2022] GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:19:01.408410 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-059ca579-4c1a-45c9-93b9-59356a4fa409 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:19:01.409042 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-059ca579-4c1a-45c9-93b9-59356a4fa409 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 39af8515-9818-4664-9e32-7a8a318f02c6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:19:01.415813 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-059ca579-4c1a-45c9-93b9-59356a4fa409 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:01.416272 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-059ca579-4c1a-45c9-93b9-59356a4fa409 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:01.417063 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-059ca579-4c1a-45c9-93b9-59356a4fa409 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:01.417508 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-059ca579-4c1a-45c9-93b9-59356a4fa409 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:01.550123 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-059ca579-4c1a-45c9-93b9-59356a4fa409 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:19:01.558264 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-059ca579-4c1a-45c9-93b9-59356a4fa409 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6" status: 200 len: 1736 microversion: 2.1 time: 0.153666 Jul 28 18:19:01.558827 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 328/656] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:19:01 2022] GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:19:01.560663 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-fab43ac8-4104-499e-95f4-1b8bd4ff098f tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:19:01.561199 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-fab43ac8-4104-499e-95f4-1b8bd4ff098f tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:19:01.567230 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-fab43ac8-4104-499e-95f4-1b8bd4ff098f tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:01.567941 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-fab43ac8-4104-499e-95f4-1b8bd4ff098f tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:01.568710 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-fab43ac8-4104-499e-95f4-1b8bd4ff098f tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:01.569192 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-fab43ac8-4104-499e-95f4-1b8bd4ff098f tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:01.690588 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.objects.instance [None req-fab43ac8-4104-499e-95f4-1b8bd4ff098f tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lazy-loading 'services' on Instance uuid 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd {{(pid=118454) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:19:01.950949 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-fab43ac8-4104-499e-95f4-1b8bd4ff098f tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "DELETE /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd/os-volume_attachments/7b69ec86-d4d5-4957-81ba-e67b04295ed5" status: 202 len: 0 microversion: 2.1 time: 0.499389 Jul 28 18:19:01.951458 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 329/657] 10.222.0.86 () {58 vars in 1416 bytes} [Thu Jul 28 18:19:01 2022] DELETE /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd/os-volume_attachments/7b69ec86-d4d5-4957-81ba-e67b04295ed5 => generated 0 bytes in 501 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 18:19:02.579350 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-2d852435-01c6-4f08-a765-c5d0e294e36e tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:19:02.579984 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-2d852435-01c6-4f08-a765-c5d0e294e36e tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 39af8515-9818-4664-9e32-7a8a318f02c6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:19:02.586446 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2d852435-01c6-4f08-a765-c5d0e294e36e tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:02.586898 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2d852435-01c6-4f08-a765-c5d0e294e36e tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:02.588162 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2d852435-01c6-4f08-a765-c5d0e294e36e tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:02.588598 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2d852435-01c6-4f08-a765-c5d0e294e36e tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:02.719778 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-2d852435-01c6-4f08-a765-c5d0e294e36e tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:19:02.727690 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-2d852435-01c6-4f08-a765-c5d0e294e36e tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6" status: 200 len: 1736 microversion: 2.1 time: 0.152286 Jul 28 18:19:02.728886 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 329/658] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:19:02 2022] GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:19:03.750835 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-2ce445ef-ae61-4116-bae0-cca878ab92be tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:19:03.751515 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-2ce445ef-ae61-4116-bae0-cca878ab92be tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 39af8515-9818-4664-9e32-7a8a318f02c6] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:19:03.757920 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2ce445ef-ae61-4116-bae0-cca878ab92be tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:03.758374 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2ce445ef-ae61-4116-bae0-cca878ab92be tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:03.759144 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2ce445ef-ae61-4116-bae0-cca878ab92be tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:03.759585 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2ce445ef-ae61-4116-bae0-cca878ab92be tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:03.887180 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-2ce445ef-ae61-4116-bae0-cca878ab92be tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:19:03.902819 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-2ce445ef-ae61-4116-bae0-cca878ab92be tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6" status: 200 len: 1736 microversion: 2.1 time: 0.156791 Jul 28 18:19:03.903398 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 330/659] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:19:03 2022] GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:19:04.122278 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-1fed508c-affb-4232-80d1-051fdeefaeb7 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:19:04.128689 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1fed508c-affb-4232-80d1-051fdeefaeb7 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:04.129183 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1fed508c-affb-4232-80d1-051fdeefaeb7 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:04.150666 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-1fed508c-affb-4232-80d1-051fdeefaeb7 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Going to try to stop instance {{(pid=118453) force_stop /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 18:19:04.290952 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-1fed508c-affb-4232-80d1-051fdeefaeb7 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "POST /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd/action" status: 202 len: 0 microversion: 2.1 time: 0.172277 Jul 28 18:19:04.291562 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 330/660] 10.222.0.86 () {60 vars in 1278 bytes} [Thu Jul 28 18:19:04 2022] POST /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 18:19:04.299807 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-002ea469-1eda-401c-9eeb-4b6c5ab127a3 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:19:04.300566 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-002ea469-1eda-401c-9eeb-4b6c5ab127a3 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:19:04.306603 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-002ea469-1eda-401c-9eeb-4b6c5ab127a3 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:04.307062 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-002ea469-1eda-401c-9eeb-4b6c5ab127a3 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:04.307834 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-002ea469-1eda-401c-9eeb-4b6c5ab127a3 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:04.308282 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-002ea469-1eda-401c-9eeb-4b6c5ab127a3 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:04.440837 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-002ea469-1eda-401c-9eeb-4b6c5ab127a3 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:19:04.449481 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-002ea469-1eda-401c-9eeb-4b6c5ab127a3 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1677 microversion: 2.1 time: 0.153634 Jul 28 18:19:04.450056 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 331/661] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:19:04 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:19:04.925809 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ce9b553f-82c1-429f-b41b-a46b8d8f109d tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:19:04.926487 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ce9b553f-82c1-429f-b41b-a46b8d8f109d tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 39af8515-9818-4664-9e32-7a8a318f02c6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:19:04.933264 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ce9b553f-82c1-429f-b41b-a46b8d8f109d tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:04.933707 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ce9b553f-82c1-429f-b41b-a46b8d8f109d tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:04.934459 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ce9b553f-82c1-429f-b41b-a46b8d8f109d tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:04.934891 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ce9b553f-82c1-429f-b41b-a46b8d8f109d tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:05.064557 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ce9b553f-82c1-429f-b41b-a46b8d8f109d tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:19:05.072528 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ce9b553f-82c1-429f-b41b-a46b8d8f109d tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6" status: 200 len: 1736 microversion: 2.1 time: 0.151036 Jul 28 18:19:05.073114 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 331/662] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:19:04 2022] GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:19:05.471442 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-4d1561b7-6979-4d66-b2cf-d6ebe16a3ab1 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:19:05.472065 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-4d1561b7-6979-4d66-b2cf-d6ebe16a3ab1 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:19:05.479864 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-4d1561b7-6979-4d66-b2cf-d6ebe16a3ab1 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:05.480312 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-4d1561b7-6979-4d66-b2cf-d6ebe16a3ab1 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:05.481107 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-4d1561b7-6979-4d66-b2cf-d6ebe16a3ab1 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:05.481546 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-4d1561b7-6979-4d66-b2cf-d6ebe16a3ab1 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:05.612503 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-4d1561b7-6979-4d66-b2cf-d6ebe16a3ab1 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:19:05.619886 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-4d1561b7-6979-4d66-b2cf-d6ebe16a3ab1 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1677 microversion: 2.1 time: 0.152240 Jul 28 18:19:05.620446 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 332/663] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:19:05 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:19:06.094393 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-81089a8c-bc40-4a5b-92a0-d9e3d5dbe9a0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:19:06.095015 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-81089a8c-bc40-4a5b-92a0-d9e3d5dbe9a0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 39af8515-9818-4664-9e32-7a8a318f02c6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:19:06.101502 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-81089a8c-bc40-4a5b-92a0-d9e3d5dbe9a0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:06.101956 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-81089a8c-bc40-4a5b-92a0-d9e3d5dbe9a0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:06.102725 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-81089a8c-bc40-4a5b-92a0-d9e3d5dbe9a0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:06.103170 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-81089a8c-bc40-4a5b-92a0-d9e3d5dbe9a0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:06.229502 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-81089a8c-bc40-4a5b-92a0-d9e3d5dbe9a0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:19:06.237460 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-81089a8c-bc40-4a5b-92a0-d9e3d5dbe9a0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6" status: 200 len: 1736 microversion: 2.1 time: 0.147197 Jul 28 18:19:06.238028 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 332/664] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:19:06 2022] GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:19:06.641305 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-2c94a7d8-1cf5-4706-b89e-d360dac0cabb tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:19:06.641942 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-2c94a7d8-1cf5-4706-b89e-d360dac0cabb tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:19:06.648444 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2c94a7d8-1cf5-4706-b89e-d360dac0cabb tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:06.648890 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2c94a7d8-1cf5-4706-b89e-d360dac0cabb tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:06.650320 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2c94a7d8-1cf5-4706-b89e-d360dac0cabb tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:06.650758 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2c94a7d8-1cf5-4706-b89e-d360dac0cabb tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:06.778921 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-2c94a7d8-1cf5-4706-b89e-d360dac0cabb tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:19:06.786344 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-2c94a7d8-1cf5-4706-b89e-d360dac0cabb tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1677 microversion: 2.1 time: 0.149006 Jul 28 18:19:06.786914 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 333/665] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:19:06 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:19:07.259037 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ec30229f-021a-4772-b1d4-7207969b65ca tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:19:07.260229 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ec30229f-021a-4772-b1d4-7207969b65ca tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 39af8515-9818-4664-9e32-7a8a318f02c6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:19:07.266736 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ec30229f-021a-4772-b1d4-7207969b65ca tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:07.267195 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ec30229f-021a-4772-b1d4-7207969b65ca tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:07.267963 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ec30229f-021a-4772-b1d4-7207969b65ca tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:07.268436 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ec30229f-021a-4772-b1d4-7207969b65ca tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:07.397267 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ec30229f-021a-4772-b1d4-7207969b65ca tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:19:07.405103 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ec30229f-021a-4772-b1d4-7207969b65ca tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6" status: 200 len: 1736 microversion: 2.1 time: 0.149954 Jul 28 18:19:07.405683 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 333/666] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:19:07 2022] GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:19:07.807555 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-c498666a-fed8-48ed-906e-e29b07664b6e tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:19:07.808210 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-c498666a-fed8-48ed-906e-e29b07664b6e tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:19:07.814602 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c498666a-fed8-48ed-906e-e29b07664b6e tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:07.815059 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c498666a-fed8-48ed-906e-e29b07664b6e tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:07.815824 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c498666a-fed8-48ed-906e-e29b07664b6e tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:07.816272 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c498666a-fed8-48ed-906e-e29b07664b6e tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:07.947950 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-c498666a-fed8-48ed-906e-e29b07664b6e tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:19:07.955482 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-c498666a-fed8-48ed-906e-e29b07664b6e tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1677 microversion: 2.1 time: 0.151846 Jul 28 18:19:07.956049 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 334/667] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:19:07 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:19:08.426513 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-7359f1ab-8cab-47fa-9207-2ddb9c756efc tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:19:08.427125 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-7359f1ab-8cab-47fa-9207-2ddb9c756efc tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 39af8515-9818-4664-9e32-7a8a318f02c6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:19:08.434507 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7359f1ab-8cab-47fa-9207-2ddb9c756efc tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:08.434954 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7359f1ab-8cab-47fa-9207-2ddb9c756efc tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:08.435708 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7359f1ab-8cab-47fa-9207-2ddb9c756efc tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:08.436141 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7359f1ab-8cab-47fa-9207-2ddb9c756efc tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:08.564129 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-7359f1ab-8cab-47fa-9207-2ddb9c756efc tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:19:08.572644 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-7359f1ab-8cab-47fa-9207-2ddb9c756efc tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6" status: 200 len: 1736 microversion: 2.1 time: 0.149984 Jul 28 18:19:08.573237 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 334/668] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:19:08 2022] GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:19:08.977581 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-391eff49-5fd9-4559-b165-c9904339917a tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:19:08.978191 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-391eff49-5fd9-4559-b165-c9904339917a tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:19:08.985126 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-391eff49-5fd9-4559-b165-c9904339917a tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:08.985579 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-391eff49-5fd9-4559-b165-c9904339917a tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:08.986338 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-391eff49-5fd9-4559-b165-c9904339917a tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:08.986779 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-391eff49-5fd9-4559-b165-c9904339917a tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:09.114631 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-391eff49-5fd9-4559-b165-c9904339917a tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:19:09.122632 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-391eff49-5fd9-4559-b165-c9904339917a tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1677 microversion: 2.1 time: 0.149089 Jul 28 18:19:09.123200 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 335/669] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:19:08 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:19:09.594512 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f25670db-616f-402f-a3ff-887f3da4e303 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:19:09.595125 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f25670db-616f-402f-a3ff-887f3da4e303 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 39af8515-9818-4664-9e32-7a8a318f02c6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:19:09.601667 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f25670db-616f-402f-a3ff-887f3da4e303 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:09.602120 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f25670db-616f-402f-a3ff-887f3da4e303 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:09.602889 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f25670db-616f-402f-a3ff-887f3da4e303 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:09.603338 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f25670db-616f-402f-a3ff-887f3da4e303 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:09.741171 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f25670db-616f-402f-a3ff-887f3da4e303 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:19:09.749260 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f25670db-616f-402f-a3ff-887f3da4e303 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6" status: 200 len: 1736 microversion: 2.1 time: 0.158911 Jul 28 18:19:09.749838 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 335/670] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:19:09 2022] GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:19:10.143569 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-a98a744b-ec8f-4d88-a926-fbb15da50ba4 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:19:10.144188 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-a98a744b-ec8f-4d88-a926-fbb15da50ba4 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:19:10.150616 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a98a744b-ec8f-4d88-a926-fbb15da50ba4 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:10.151071 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a98a744b-ec8f-4d88-a926-fbb15da50ba4 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:10.151836 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a98a744b-ec8f-4d88-a926-fbb15da50ba4 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:10.152279 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a98a744b-ec8f-4d88-a926-fbb15da50ba4 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:10.286100 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-a98a744b-ec8f-4d88-a926-fbb15da50ba4 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:19:10.289693 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:19:10.294905 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-a98a744b-ec8f-4d88-a926-fbb15da50ba4 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1677 microversion: 2.1 time: 0.155209 Jul 28 18:19:10.295482 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 336/671] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:19:10 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:19:10.770797 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-e0019bae-2a0d-4213-a154-7eff4ab1eebf tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:19:10.771367 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-e0019bae-2a0d-4213-a154-7eff4ab1eebf tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 39af8515-9818-4664-9e32-7a8a318f02c6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:19:10.773363 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=28 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:19:10.778620 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e0019bae-2a0d-4213-a154-7eff4ab1eebf tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:10.779075 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e0019bae-2a0d-4213-a154-7eff4ab1eebf tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:10.779841 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e0019bae-2a0d-4213-a154-7eff4ab1eebf tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:10.780284 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e0019bae-2a0d-4213-a154-7eff4ab1eebf tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:10.906010 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-e0019bae-2a0d-4213-a154-7eff4ab1eebf tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:19:10.913919 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-e0019bae-2a0d-4213-a154-7eff4ab1eebf tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6" status: 200 len: 1716 microversion: 2.1 time: 0.147218 Jul 28 18:19:10.914482 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 336/672] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:19:10 2022] GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6 => generated 1716 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:19:10.973491 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-57832e92-d162-4c2f-aa6e-05c5ecc4bd48 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:19:10.973985 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-57832e92-d162-4c2f-aa6e-05c5ecc4bd48 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 39af8515-9818-4664-9e32-7a8a318f02c6] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:19:10.980994 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-57832e92-d162-4c2f-aa6e-05c5ecc4bd48 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:10.981447 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-57832e92-d162-4c2f-aa6e-05c5ecc4bd48 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:10.982208 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-57832e92-d162-4c2f-aa6e-05c5ecc4bd48 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:10.982691 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-57832e92-d162-4c2f-aa6e-05c5ecc4bd48 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:11.063075 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.wsgi [None req-57832e92-d162-4c2f-aa6e-05c5ecc4bd48 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] HTTP exception thrown: Cannot 'detach_volume' instance 39af8515-9818-4664-9e32-7a8a318f02c6 while it is in vm_state rescued Jul 28 18:19:11.064669 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-57832e92-d162-4c2f-aa6e-05c5ecc4bd48 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Request method failure captured: Jul 28 18:19:11.064669 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: request: DELETE /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6/os-volume_attachments/5f35737c-241c-4033-938c-f0a90723fbba HTTP/1.1 Jul 28 18:19:11.064669 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Accept: application/json Jul 28 18:19:11.064669 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Accept-Encoding: identity Jul 28 18:19:11.064669 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Connection: close Jul 28 18:19:11.064669 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Content-Length: 0 Jul 28 18:19:11.064669 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Content-Type: application/json Jul 28 18:19:11.064669 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Host: 10.222.0.86 Jul 28 18:19:11.064669 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Openstack-System-Scope: None Jul 28 18:19:11.064669 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: User-Agent: python-urllib3/1.26.10 Jul 28 18:19:11.064669 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Auth-Token: gAAAAABi4tGak9iMP6i4DT42V1NnqmCZswp-XsfRnXwgZ5TInbJk7FNT9dOnhbjnqjtBLXPdrsj1TUIXXmpk6dZ3xWlxYxbYapUjkHD0Drg44UTheFQ5ZV9AjLn6l50Z1n5iufsCuAsTGkiWhMhNQDT75zNabsY87wD-531cxucsWWBAMcMaNMQ Jul 28 18:19:11.064669 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Domain-Id: None Jul 28 18:19:11.064669 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Domain-Name: None Jul 28 18:19:11.064669 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Identity-Status: Confirmed Jul 28 18:19:11.064669 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Is-Admin-Project: True Jul 28 18:19:11.064669 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Domain-Id: default Jul 28 18:19:11.064669 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Domain-Name: Default Jul 28 18:19:11.064669 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Id: b52f26ab8b934756b0c74d681d08d04f Jul 28 18:19:11.064669 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1347813421 Jul 28 18:19:11.064669 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Role: member,reader Jul 28 18:19:11.064669 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Roles: member,reader Jul 28 18:19:11.066067 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_b52f26ab8b934756b0c74d681d08d04f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/b52f26ab8b934756b0c74d681d08d04f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/b52f26ab8b934756b0c74d681d08d04f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/b52f26ab8b934756b0c74d681d08d04f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}] Jul 28 18:19:11.066067 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1347813421 Jul 28 18:19:11.066067 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant-Id: b52f26ab8b934756b0c74d681d08d04f Jul 28 18:19:11.066067 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1347813421 Jul 28 18:19:11.066067 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User: tempest-ServerRescueNegativeTestJSON-1347813421-project Jul 28 18:19:11.066067 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Domain-Id: default Jul 28 18:19:11.066067 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Domain-Name: Default Jul 28 18:19:11.066067 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Id: 5ef698c4f57f44d387550921a288d7ab Jul 28 18:19:11.066067 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1347813421-project Jul 28 18:19:11.066067 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: method: > Jul 28 18:19:11.066067 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: exception: Cannot 'detach_volume' instance 39af8515-9818-4664-9e32-7a8a318f02c6 while it is in vm_state rescued Jul 28 18:19:11.066782 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: action_args: {'server_id': '39af8515-9818-4664-9e32-7a8a318f02c6', 'id': '5f35737c-241c-4033-938c-f0a90723fbba'} Jul 28 18:19:11.066782 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:19:11.066782 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:19:11.066782 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 28 18:19:11.066782 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 28 18:19:11.066782 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 18:19:11.066782 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 18:19:11.066782 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Jul 28 18:19:11.066782 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 28 18:19:11.066782 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 39af8515-9818-4664-9e32-7a8a318f02c6 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 28 18:19:11.066782 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:19:11.066782 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:19:11.066782 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:19:11.066782 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:19:11.066782 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:19:11.066782 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:19:11.066782 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:19:11.066782 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:19:11.066782 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:19:11.066782 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:19:11.068079 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 28 18:19:11.068079 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 28 18:19:11.068079 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 28 18:19:11.068079 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 28 18:19:11.068079 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 39af8515-9818-4664-9e32-7a8a318f02c6 while it is in vm_state rescued Jul 28 18:19:11.068079 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:19:11.068079 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:19:11.068079 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:19:11.068079 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:19:11.068079 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:19:11.068079 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:19:11.068079 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:19:11.068079 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:19:11.068079 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 39af8515-9818-4664-9e32-7a8a318f02c6 while it is in vm_state rescued Jul 28 18:19:11.068079 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:19:11.068079 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-57832e92-d162-4c2f-aa6e-05c5ecc4bd48 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Returning 409 to user: Cannot 'detach_volume' instance 39af8515-9818-4664-9e32-7a8a318f02c6 while it is in vm_state rescued {{(pid=118454) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:19:11.069072 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-57832e92-d162-4c2f-aa6e-05c5ecc4bd48 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "DELETE /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6/os-volume_attachments/5f35737c-241c-4033-938c-f0a90723fbba" status: 409 len: 152 microversion: 2.1 time: 0.097045 Jul 28 18:19:11.069072 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 337/673] 10.222.0.86 () {58 vars in 1416 bytes} [Thu Jul 28 18:19:10 2022] DELETE /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6/os-volume_attachments/5f35737c-241c-4033-938c-f0a90723fbba => generated 152 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 28 18:19:11.075742 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-71f00abd-0084-4be4-a3c2-6d72762489df tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:19:11.076282 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-71f00abd-0084-4be4-a3c2-6d72762489df tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 39af8515-9818-4664-9e32-7a8a318f02c6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:19:11.082261 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-71f00abd-0084-4be4-a3c2-6d72762489df tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:11.082713 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-71f00abd-0084-4be4-a3c2-6d72762489df tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:11.083477 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-71f00abd-0084-4be4-a3c2-6d72762489df tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:11.083916 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-71f00abd-0084-4be4-a3c2-6d72762489df tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:11.301443 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-71f00abd-0084-4be4-a3c2-6d72762489df tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "POST /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6/action" status: 202 len: 0 microversion: 2.1 time: 0.229798 Jul 28 18:19:11.301988 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 337/674] 10.222.0.86 () {60 vars in 1278 bytes} [Thu Jul 28 18:19:11 2022] POST /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 18:19:11.310935 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-d146e6ad-67ab-4dcf-96de-05ba73818ac5 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:19:11.311558 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-d146e6ad-67ab-4dcf-96de-05ba73818ac5 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 39af8515-9818-4664-9e32-7a8a318f02c6] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:19:11.317965 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-4f55d44f-7f36-482d-bc65-dfc987d3e470 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:19:11.318743 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-4f55d44f-7f36-482d-bc65-dfc987d3e470 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:19:11.320147 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d146e6ad-67ab-4dcf-96de-05ba73818ac5 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:11.320613 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d146e6ad-67ab-4dcf-96de-05ba73818ac5 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:11.321439 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d146e6ad-67ab-4dcf-96de-05ba73818ac5 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:11.321882 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d146e6ad-67ab-4dcf-96de-05ba73818ac5 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:11.325568 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4f55d44f-7f36-482d-bc65-dfc987d3e470 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:11.326027 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4f55d44f-7f36-482d-bc65-dfc987d3e470 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:11.326810 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4f55d44f-7f36-482d-bc65-dfc987d3e470 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:11.327275 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4f55d44f-7f36-482d-bc65-dfc987d3e470 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:11.520348 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-d146e6ad-67ab-4dcf-96de-05ba73818ac5 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:19:11.526553 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-4f55d44f-7f36-482d-bc65-dfc987d3e470 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:19:11.530123 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-d146e6ad-67ab-4dcf-96de-05ba73818ac5 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6" status: 200 len: 1724 microversion: 2.1 time: 0.223200 Jul 28 18:19:11.531096 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 338/675] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:19:11 2022] GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6 => generated 1724 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:19:11.538015 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-4f55d44f-7f36-482d-bc65-dfc987d3e470 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1677 microversion: 2.1 time: 0.224240 Jul 28 18:19:11.538874 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 338/676] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:19:11 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1677 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:19:12.551751 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-f4232540-218c-4978-ae77-276e7c90379b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:19:12.552362 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-f4232540-218c-4978-ae77-276e7c90379b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 39af8515-9818-4664-9e32-7a8a318f02c6] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:19:12.559034 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f4232540-218c-4978-ae77-276e7c90379b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:12.559403 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-056c1f9e-d4cb-49e0-899f-382ac16539ec tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:19:12.559904 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f4232540-218c-4978-ae77-276e7c90379b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:12.560021 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-056c1f9e-d4cb-49e0-899f-382ac16539ec tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:19:12.560239 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f4232540-218c-4978-ae77-276e7c90379b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:12.560682 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f4232540-218c-4978-ae77-276e7c90379b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:12.566348 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-056c1f9e-d4cb-49e0-899f-382ac16539ec tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:12.566800 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-056c1f9e-d4cb-49e0-899f-382ac16539ec tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:12.567589 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-056c1f9e-d4cb-49e0-899f-382ac16539ec tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:12.568021 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-056c1f9e-d4cb-49e0-899f-382ac16539ec tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:12.572085 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:19:12.751858 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-f4232540-218c-4978-ae77-276e7c90379b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:19:12.758613 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-056c1f9e-d4cb-49e0-899f-382ac16539ec tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:19:12.760503 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-f4232540-218c-4978-ae77-276e7c90379b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6" status: 200 len: 1724 microversion: 2.1 time: 0.212064 Jul 28 18:19:12.761113 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 339/677] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:19:12 2022] GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6 => generated 1724 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:19:12.766848 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-056c1f9e-d4cb-49e0-899f-382ac16539ec tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1677 microversion: 2.1 time: 0.211267 Jul 28 18:19:12.767401 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 339/678] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:19:12 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1677 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:19:13.781714 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-917918fc-ae1c-4211-b05b-461dcb9a5a6a tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:19:13.782305 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-917918fc-ae1c-4211-b05b-461dcb9a5a6a tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 39af8515-9818-4664-9e32-7a8a318f02c6] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:19:13.787338 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-59ba4d24-86a8-4429-bfea-39debc973867 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:19:13.787956 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-59ba4d24-86a8-4429-bfea-39debc973867 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:19:13.788919 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-917918fc-ae1c-4211-b05b-461dcb9a5a6a tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:13.789407 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-917918fc-ae1c-4211-b05b-461dcb9a5a6a tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:13.790181 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-917918fc-ae1c-4211-b05b-461dcb9a5a6a tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:13.790623 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-917918fc-ae1c-4211-b05b-461dcb9a5a6a tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:13.794366 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-59ba4d24-86a8-4429-bfea-39debc973867 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:13.794822 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-59ba4d24-86a8-4429-bfea-39debc973867 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:13.795635 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-59ba4d24-86a8-4429-bfea-39debc973867 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:13.796083 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-59ba4d24-86a8-4429-bfea-39debc973867 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:14.220947 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-917918fc-ae1c-4211-b05b-461dcb9a5a6a tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:19:14.228513 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-59ba4d24-86a8-4429-bfea-39debc973867 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:19:14.229520 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-917918fc-ae1c-4211-b05b-461dcb9a5a6a tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6" status: 200 len: 1724 microversion: 2.1 time: 0.451694 Jul 28 18:19:14.230336 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 340/679] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:19:13 2022] GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6 => generated 1724 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:19:14.236277 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-59ba4d24-86a8-4429-bfea-39debc973867 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1677 microversion: 2.1 time: 0.452703 Jul 28 18:19:14.236949 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 340/680] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:19:13 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1677 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:19:15.249548 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-33d04833-7de4-4d53-9f54-bff229d7f93f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:19:15.250135 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-33d04833-7de4-4d53-9f54-bff229d7f93f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 39af8515-9818-4664-9e32-7a8a318f02c6] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:19:15.256564 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-33d04833-7de4-4d53-9f54-bff229d7f93f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:15.257048 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-33d04833-7de4-4d53-9f54-bff229d7f93f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:15.257734 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0027b800-4ee1-4f9d-8d71-ea620f7f4b6f tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:19:15.258152 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-33d04833-7de4-4d53-9f54-bff229d7f93f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:15.258253 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-33d04833-7de4-4d53-9f54-bff229d7f93f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:15.258349 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0027b800-4ee1-4f9d-8d71-ea620f7f4b6f tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:19:15.264886 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0027b800-4ee1-4f9d-8d71-ea620f7f4b6f tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:15.265375 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0027b800-4ee1-4f9d-8d71-ea620f7f4b6f tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:15.266135 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0027b800-4ee1-4f9d-8d71-ea620f7f4b6f tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:15.266574 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0027b800-4ee1-4f9d-8d71-ea620f7f4b6f tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:15.467446 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-33d04833-7de4-4d53-9f54-bff229d7f93f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:19:15.470771 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-0027b800-4ee1-4f9d-8d71-ea620f7f4b6f tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:19:15.475940 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-33d04833-7de4-4d53-9f54-bff229d7f93f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6" status: 200 len: 1724 microversion: 2.1 time: 0.230116 Jul 28 18:19:15.476512 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 341/681] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:19:15 2022] GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6 => generated 1724 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:19:15.479119 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0027b800-4ee1-4f9d-8d71-ea620f7f4b6f tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1677 microversion: 2.1 time: 0.224689 Jul 28 18:19:15.479713 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 341/682] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:19:15 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1677 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:19:16.498304 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-70d89820-1794-49e1-a430-116676ccd1f7 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:19:16.498954 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-70d89820-1794-49e1-a430-116676ccd1f7 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 39af8515-9818-4664-9e32-7a8a318f02c6] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:19:16.499954 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-9fe8c1c1-64b6-4198-91a0-9a5abf290bc4 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:19:16.500616 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-9fe8c1c1-64b6-4198-91a0-9a5abf290bc4 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:19:16.505646 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-70d89820-1794-49e1-a430-116676ccd1f7 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:16.506101 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-70d89820-1794-49e1-a430-116676ccd1f7 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:16.506876 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-70d89820-1794-49e1-a430-116676ccd1f7 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:16.507170 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9fe8c1c1-64b6-4198-91a0-9a5abf290bc4 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:16.507315 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-70d89820-1794-49e1-a430-116676ccd1f7 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:16.507623 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9fe8c1c1-64b6-4198-91a0-9a5abf290bc4 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:16.508394 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9fe8c1c1-64b6-4198-91a0-9a5abf290bc4 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:16.508838 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9fe8c1c1-64b6-4198-91a0-9a5abf290bc4 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:16.704883 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-70d89820-1794-49e1-a430-116676ccd1f7 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:19:16.708114 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-9fe8c1c1-64b6-4198-91a0-9a5abf290bc4 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:19:16.713498 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-70d89820-1794-49e1-a430-116676ccd1f7 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6" status: 200 len: 1730 microversion: 2.1 time: 0.219306 Jul 28 18:19:16.725620 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 342/683] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:19:16 2022] GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6 => generated 1730 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:19:16.725753 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-9fe8c1c1-64b6-4198-91a0-9a5abf290bc4 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1677 microversion: 2.1 time: 0.220270 Jul 28 18:19:16.725753 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 342/684] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:19:16 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1677 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:19:16.734581 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-f045090e-ca70-4921-b086-409747b8a0ac tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:19:16.735073 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-f045090e-ca70-4921-b086-409747b8a0ac tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 39af8515-9818-4664-9e32-7a8a318f02c6] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:19:16.741033 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f045090e-ca70-4921-b086-409747b8a0ac tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:16.741491 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f045090e-ca70-4921-b086-409747b8a0ac tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:16.742257 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f045090e-ca70-4921-b086-409747b8a0ac tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:16.742691 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f045090e-ca70-4921-b086-409747b8a0ac tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:16.820440 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-f045090e-ca70-4921-b086-409747b8a0ac tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089501 Jul 28 18:19:16.821048 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 343/685] 10.222.0.86 () {58 vars in 1275 bytes} [Thu Jul 28 18:19:16 2022] GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:19:17.738561 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0e0236c6-2436-4678-bcae-6530652079eb tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:19:17.740141 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0e0236c6-2436-4678-bcae-6530652079eb tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:19:17.746365 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0e0236c6-2436-4678-bcae-6530652079eb tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:17.747039 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0e0236c6-2436-4678-bcae-6530652079eb tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:17.747945 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0e0236c6-2436-4678-bcae-6530652079eb tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:17.748360 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0e0236c6-2436-4678-bcae-6530652079eb tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:17.757831 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [req-5bb34e57-f028-4074-9352-90ef48030481 req-62d93d2b-4498-43ff-9612-7bf094691c0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39af8515-9818-4664-9e32-7a8a318f02c6", "tag": "f0dbd9bf-00f9-4a54-976e-f94921af3d46"}]} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:19:17.772728 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-5bb34e57-f028-4074-9352-90ef48030481 req-62d93d2b-4498-43ff-9612-7bf094691c0e service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:17.774610 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-5bb34e57-f028-4074-9352-90ef48030481 req-62d93d2b-4498-43ff-9612-7bf094691c0e service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:17.787210 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.compute.server_external_events [req-5bb34e57-f028-4074-9352-90ef48030481 req-62d93d2b-4498-43ff-9612-7bf094691c0e service nova] Creating event network-changed:f0dbd9bf-00f9-4a54-976e-f94921af3d46 for instance 39af8515-9818-4664-9e32-7a8a318f02c6 on hv-cinder-84617 Jul 28 18:19:17.793676 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [req-5bb34e57-f028-4074-9352-90ef48030481 req-62d93d2b-4498-43ff-9612-7bf094691c0e service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040763 Jul 28 18:19:17.794563 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 344/686] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:19:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 18:19:17.898460 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-0e0236c6-2436-4678-bcae-6530652079eb tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:19:17.906517 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0e0236c6-2436-4678-bcae-6530652079eb tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1677 microversion: 2.1 time: 0.171965 Jul 28 18:19:17.915803 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 343/687] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:19:17 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1677 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:19:18.929992 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-f4ae6b7c-0bfc-4774-88f7-9e002e9c3170 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:19:18.930718 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-f4ae6b7c-0bfc-4774-88f7-9e002e9c3170 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:19:18.937025 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f4ae6b7c-0bfc-4774-88f7-9e002e9c3170 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:18.937470 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f4ae6b7c-0bfc-4774-88f7-9e002e9c3170 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:18.938222 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f4ae6b7c-0bfc-4774-88f7-9e002e9c3170 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:18.938689 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f4ae6b7c-0bfc-4774-88f7-9e002e9c3170 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:19.069273 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-f4ae6b7c-0bfc-4774-88f7-9e002e9c3170 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:19:19.076645 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-f4ae6b7c-0bfc-4774-88f7-9e002e9c3170 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1677 microversion: 2.1 time: 0.151532 Jul 28 18:19:19.077250 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 345/688] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:19:18 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:19:19.813131 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-60510b76-5da3-4068-aacf-4eccd52b1399 req-923a0872-255c-4411-8732-9e87bb637c77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39af8515-9818-4664-9e32-7a8a318f02c6", "tag": "f0dbd9bf-00f9-4a54-976e-f94921af3d46"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:19:19.823645 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-60510b76-5da3-4068-aacf-4eccd52b1399 req-923a0872-255c-4411-8732-9e87bb637c77 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:19.824110 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-60510b76-5da3-4068-aacf-4eccd52b1399 req-923a0872-255c-4411-8732-9e87bb637c77 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:19.835009 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-60510b76-5da3-4068-aacf-4eccd52b1399 req-923a0872-255c-4411-8732-9e87bb637c77 service nova] Creating event network-changed:f0dbd9bf-00f9-4a54-976e-f94921af3d46 for instance 39af8515-9818-4664-9e32-7a8a318f02c6 on hv-cinder-84617 Jul 28 18:19:19.839940 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-60510b76-5da3-4068-aacf-4eccd52b1399 req-923a0872-255c-4411-8732-9e87bb637c77 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030664 Jul 28 18:19:19.840775 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 344/689] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:19:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:19:20.099369 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-029c3a29-fdc1-419c-8b7b-c9dc7363e6c3 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:19:20.100118 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-029c3a29-fdc1-419c-8b7b-c9dc7363e6c3 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:19:20.102563 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_api:SELECT=48 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:19:20.107795 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-029c3a29-fdc1-419c-8b7b-c9dc7363e6c3 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:20.108242 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-029c3a29-fdc1-419c-8b7b-c9dc7363e6c3 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:20.109042 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-029c3a29-fdc1-419c-8b7b-c9dc7363e6c3 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:20.109481 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-029c3a29-fdc1-419c-8b7b-c9dc7363e6c3 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:20.239390 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-029c3a29-fdc1-419c-8b7b-c9dc7363e6c3 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:19:20.247162 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-029c3a29-fdc1-419c-8b7b-c9dc7363e6c3 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1677 microversion: 2.1 time: 0.152405 Jul 28 18:19:20.247965 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 346/690] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:19:20 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:19:21.270128 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-694092b0-7abf-4239-b741-241a2e6b37dc tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:19:21.270762 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-694092b0-7abf-4239-b741-241a2e6b37dc tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:19:21.277496 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-694092b0-7abf-4239-b741-241a2e6b37dc tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:21.277944 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-694092b0-7abf-4239-b741-241a2e6b37dc tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:21.278704 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-694092b0-7abf-4239-b741-241a2e6b37dc tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:21.279141 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-694092b0-7abf-4239-b741-241a2e6b37dc tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:21.406705 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-694092b0-7abf-4239-b741-241a2e6b37dc tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:19:21.414329 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-694092b0-7abf-4239-b741-241a2e6b37dc tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1654 microversion: 2.1 time: 0.149157 Jul 28 18:19:21.415092 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 345/691] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:19:21 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1654 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:19:21.435307 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-1d00e805-7fa5-4fe5-9513-bf127fc604a4 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:19:21.441992 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-1d00e805-7fa5-4fe5-9513-bf127fc604a4 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:21.442448 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-1d00e805-7fa5-4fe5-9513-bf127fc604a4 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:21.464476 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-1d00e805-7fa5-4fe5-9513-bf127fc604a4 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Going to try to start instance {{(pid=118454) start /opt/stack/nova/nova/compute/api.py:2733}} Jul 28 18:19:21.639420 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-1d00e805-7fa5-4fe5-9513-bf127fc604a4 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "POST /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd/action" status: 202 len: 0 microversion: 2.1 time: 0.207901 Jul 28 18:19:21.640028 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 347/692] 10.222.0.86 () {60 vars in 1278 bytes} [Thu Jul 28 18:19:21 2022] POST /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 18:19:21.648289 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-11dba0ed-bb9d-420a-a1f5-34b56c773087 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:19:21.649131 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-11dba0ed-bb9d-420a-a1f5-34b56c773087 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:19:21.655561 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-11dba0ed-bb9d-420a-a1f5-34b56c773087 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:21.656015 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-11dba0ed-bb9d-420a-a1f5-34b56c773087 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:21.656790 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-11dba0ed-bb9d-420a-a1f5-34b56c773087 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:21.657260 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-11dba0ed-bb9d-420a-a1f5-34b56c773087 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:21.792036 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-11dba0ed-bb9d-420a-a1f5-34b56c773087 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:19:21.799831 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-11dba0ed-bb9d-420a-a1f5-34b56c773087 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1663 microversion: 2.1 time: 0.155389 Jul 28 18:19:21.801253 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 346/693] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:19:21 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1663 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:19:22.823676 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-db32047f-54af-4aca-ad78-ede83e095c37 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:19:22.824378 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-db32047f-54af-4aca-ad78-ede83e095c37 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:19:22.830619 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-db32047f-54af-4aca-ad78-ede83e095c37 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:22.831074 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-db32047f-54af-4aca-ad78-ede83e095c37 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:22.831845 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-db32047f-54af-4aca-ad78-ede83e095c37 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:22.832285 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-db32047f-54af-4aca-ad78-ede83e095c37 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:22.963578 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-db32047f-54af-4aca-ad78-ede83e095c37 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:19:22.972449 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-db32047f-54af-4aca-ad78-ede83e095c37 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1663 microversion: 2.1 time: 0.154068 Jul 28 18:19:22.973056 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 348/694] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:19:22 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1663 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:19:23.994655 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-86aacdbe-6e23-4bf4-b3ac-5b3806c2a9f4 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:19:23.995315 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-86aacdbe-6e23-4bf4-b3ac-5b3806c2a9f4 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:19:24.002024 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-86aacdbe-6e23-4bf4-b3ac-5b3806c2a9f4 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:24.002471 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-86aacdbe-6e23-4bf4-b3ac-5b3806c2a9f4 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:24.003224 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-86aacdbe-6e23-4bf4-b3ac-5b3806c2a9f4 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:24.003657 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-86aacdbe-6e23-4bf4-b3ac-5b3806c2a9f4 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:24.133675 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-86aacdbe-6e23-4bf4-b3ac-5b3806c2a9f4 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:19:24.141289 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-86aacdbe-6e23-4bf4-b3ac-5b3806c2a9f4 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1667 microversion: 2.1 time: 0.151158 Jul 28 18:19:24.141855 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 347/695] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:19:23 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1667 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:19:41.662468 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-d8a9327b-8cdf-40f7-8644-00925ff16841 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:19:41.663567 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-d8a9327b-8cdf-40f7-8644-00925ff16841 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:19:41.665810 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_api:SELECT=5 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:19:41.666536 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:19:41.671190 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d8a9327b-8cdf-40f7-8644-00925ff16841 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:41.671641 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d8a9327b-8cdf-40f7-8644-00925ff16841 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:41.672400 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d8a9327b-8cdf-40f7-8644-00925ff16841 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:41.672836 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d8a9327b-8cdf-40f7-8644-00925ff16841 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:41.705575 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-d8a9327b-8cdf-40f7-8644-00925ff16841 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286/os-volume_attachments/51b95e52-f117-45ea-a8ef-f82ae5f341bb" status: 200 len: 194 microversion: 2.20 time: 0.047609 Jul 28 18:19:41.706099 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 349/696] 10.222.0.86 () {60 vars in 1454 bytes} [Thu Jul 28 18:19:41 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286/os-volume_attachments/51b95e52-f117-45ea-a8ef-f82ae5f341bb => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 18:19:41.772652 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a92c157c-d166-4c8d-ba42-762664d9b8dc tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:19:41.773235 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-a92c157c-d166-4c8d-ba42-762664d9b8dc tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:19:41.775393 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=23 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:19:41.776039 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=48 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:19:41.780754 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a92c157c-d166-4c8d-ba42-762664d9b8dc tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:41.782457 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a92c157c-d166-4c8d-ba42-762664d9b8dc tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:41.782457 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a92c157c-d166-4c8d-ba42-762664d9b8dc tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:41.782457 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a92c157c-d166-4c8d-ba42-762664d9b8dc tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:41.906979 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.objects.instance [None req-a92c157c-d166-4c8d-ba42-762664d9b8dc tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lazy-loading 'services' on Instance uuid 2b1c63c9-4f4b-4c9e-91da-42f88fd63286 {{(pid=118453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:19:42.143554 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-a92c157c-d166-4c8d-ba42-762664d9b8dc tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "DELETE /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286/os-volume_attachments/51b95e52-f117-45ea-a8ef-f82ae5f341bb" status: 202 len: 0 microversion: 2.20 time: 0.374830 Jul 28 18:19:42.144875 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 348/697] 10.222.0.86 () {60 vars in 1457 bytes} [Thu Jul 28 18:19:41 2022] DELETE /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286/os-volume_attachments/51b95e52-f117-45ea-a8ef-f82ae5f341bb => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 18:19:42.153988 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-350496c6-f5be-4e86-9e91-69a33a3da1ad tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:19:42.156223 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-350496c6-f5be-4e86-9e91-69a33a3da1ad tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:19:42.162939 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-350496c6-f5be-4e86-9e91-69a33a3da1ad tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:42.163420 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-350496c6-f5be-4e86-9e91-69a33a3da1ad tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:42.164194 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-350496c6-f5be-4e86-9e91-69a33a3da1ad tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:42.164655 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-350496c6-f5be-4e86-9e91-69a33a3da1ad tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:42.195746 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-350496c6-f5be-4e86-9e91-69a33a3da1ad tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046408 Jul 28 18:19:42.196343 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 350/698] 10.222.0.86 () {60 vars in 1343 bytes} [Thu Jul 28 18:19:42 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 18:19:43.208921 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f3948e1f-a2f6-45c4-9dd5-ab5ca8d3fab2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:19:43.211419 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f3948e1f-a2f6-45c4-9dd5-ab5ca8d3fab2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:19:43.217944 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f3948e1f-a2f6-45c4-9dd5-ab5ca8d3fab2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:43.220196 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f3948e1f-a2f6-45c4-9dd5-ab5ca8d3fab2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:43.220196 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f3948e1f-a2f6-45c4-9dd5-ab5ca8d3fab2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:43.220196 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f3948e1f-a2f6-45c4-9dd5-ab5ca8d3fab2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:43.249903 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f3948e1f-a2f6-45c4-9dd5-ab5ca8d3fab2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045958 Jul 28 18:19:43.250491 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 349/699] 10.222.0.86 () {60 vars in 1343 bytes} [Thu Jul 28 18:19:43 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 18:19:44.262997 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-d1a4a4af-d4d3-47be-8153-906bc8c40996 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:19:44.265215 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-d1a4a4af-d4d3-47be-8153-906bc8c40996 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:19:44.272170 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d1a4a4af-d4d3-47be-8153-906bc8c40996 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:44.273698 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d1a4a4af-d4d3-47be-8153-906bc8c40996 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:44.273698 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d1a4a4af-d4d3-47be-8153-906bc8c40996 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:44.274008 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d1a4a4af-d4d3-47be-8153-906bc8c40996 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:44.301735 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-d1a4a4af-d4d3-47be-8153-906bc8c40996 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043254 Jul 28 18:19:44.302281 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 351/700] 10.222.0.86 () {60 vars in 1343 bytes} [Thu Jul 28 18:19:44 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:19:44.363550 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-4995a25d-16d0-477f-b574-ca8311c0bf8e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:19:44.364062 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-4995a25d-16d0-477f-b574-ca8311c0bf8e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:19:44.370391 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4995a25d-16d0-477f-b574-ca8311c0bf8e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:44.370838 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4995a25d-16d0-477f-b574-ca8311c0bf8e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:44.372082 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4995a25d-16d0-477f-b574-ca8311c0bf8e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:44.372512 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4995a25d-16d0-477f-b574-ca8311c0bf8e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:44.397158 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-4995a25d-16d0-477f-b574-ca8311c0bf8e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Going to try to terminate instance {{(pid=118453) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 18:19:44.664245 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-4995a25d-16d0-477f-b574-ca8311c0bf8e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "DELETE /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 204 len: 0 microversion: 2.20 time: 0.304213 Jul 28 18:19:44.664856 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 350/701] 10.222.0.86 () {60 vars in 1280 bytes} [Thu Jul 28 18:19:44 2022] DELETE /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 18:19:44.673808 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-e0edf621-b9ee-4ff8-9b67-c778d49fb3e9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:19:44.674413 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-e0edf621-b9ee-4ff8-9b67-c778d49fb3e9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:19:44.680937 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e0edf621-b9ee-4ff8-9b67-c778d49fb3e9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:44.681410 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e0edf621-b9ee-4ff8-9b67-c778d49fb3e9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:44.682157 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e0edf621-b9ee-4ff8-9b67-c778d49fb3e9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:44.682593 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e0edf621-b9ee-4ff8-9b67-c778d49fb3e9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:44.812424 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-e0edf621-b9ee-4ff8-9b67-c778d49fb3e9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:19:44.820464 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-e0edf621-b9ee-4ff8-9b67-c778d49fb3e9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:19:44.822030 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-e0edf621-b9ee-4ff8-9b67-c778d49fb3e9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:19:44.823172 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-e0edf621-b9ee-4ff8-9b67-c778d49fb3e9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1721 microversion: 2.20 time: 0.153517 Jul 28 18:19:44.823728 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 352/702] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:19:44 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:19:45.846789 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-228adacc-f2e5-4cca-8ca6-fd73bde815e9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:19:45.847486 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-228adacc-f2e5-4cca-8ca6-fd73bde815e9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:19:45.855200 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-228adacc-f2e5-4cca-8ca6-fd73bde815e9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:45.855651 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-228adacc-f2e5-4cca-8ca6-fd73bde815e9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:45.856403 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-228adacc-f2e5-4cca-8ca6-fd73bde815e9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:45.856839 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-228adacc-f2e5-4cca-8ca6-fd73bde815e9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:45.987980 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-228adacc-f2e5-4cca-8ca6-fd73bde815e9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:19:45.995825 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-228adacc-f2e5-4cca-8ca6-fd73bde815e9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:19:45.997857 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-228adacc-f2e5-4cca-8ca6-fd73bde815e9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:19:45.999014 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-228adacc-f2e5-4cca-8ca6-fd73bde815e9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1721 microversion: 2.20 time: 0.156461 Jul 28 18:19:45.999569 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 351/703] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:19:45 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:19:47.022355 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-128d1773-2000-43fa-924d-8f0ce0934fc5 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:19:47.022996 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-128d1773-2000-43fa-924d-8f0ce0934fc5 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:19:47.029994 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-128d1773-2000-43fa-924d-8f0ce0934fc5 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:47.030455 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-128d1773-2000-43fa-924d-8f0ce0934fc5 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:47.031219 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-128d1773-2000-43fa-924d-8f0ce0934fc5 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:47.031660 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-128d1773-2000-43fa-924d-8f0ce0934fc5 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:47.158954 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-128d1773-2000-43fa-924d-8f0ce0934fc5 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:19:47.167949 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-128d1773-2000-43fa-924d-8f0ce0934fc5 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:19:47.169591 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-128d1773-2000-43fa-924d-8f0ce0934fc5 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:19:47.170758 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-128d1773-2000-43fa-924d-8f0ce0934fc5 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1721 microversion: 2.20 time: 0.152365 Jul 28 18:19:47.171324 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 353/704] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:19:47 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:19:48.193769 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-6ef165da-335f-472e-8f91-c50c2bf0602a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:19:48.194304 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-6ef165da-335f-472e-8f91-c50c2bf0602a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:19:48.202986 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6ef165da-335f-472e-8f91-c50c2bf0602a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:48.203440 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6ef165da-335f-472e-8f91-c50c2bf0602a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:48.204220 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6ef165da-335f-472e-8f91-c50c2bf0602a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:48.204659 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6ef165da-335f-472e-8f91-c50c2bf0602a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:48.272559 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-6ef165da-335f-472e-8f91-c50c2bf0602a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:19:48.281878 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-6ef165da-335f-472e-8f91-c50c2bf0602a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:19:48.283519 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-6ef165da-335f-472e-8f91-c50c2bf0602a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:19:48.284708 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-6ef165da-335f-472e-8f91-c50c2bf0602a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1654 microversion: 2.20 time: 0.095116 Jul 28 18:19:48.290710 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 352/705] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:19:48 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1654 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:19:48.426680 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [req-1c53e1cd-8b8d-41f5-8858-79040546a97e req-addd0e1a-35f6-46e6-90fe-49715dd37e47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b1c63c9-4f4b-4c9e-91da-42f88fd63286", "name": "network-vif-deleted", "tag": "1d258458-0cee-481c-93c4-bf0b858d9e28"}]} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:19:48.436817 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-1c53e1cd-8b8d-41f5-8858-79040546a97e req-addd0e1a-35f6-46e6-90fe-49715dd37e47 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:48.437304 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-1c53e1cd-8b8d-41f5-8858-79040546a97e req-addd0e1a-35f6-46e6-90fe-49715dd37e47 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:48.448464 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.compute.server_external_events [req-1c53e1cd-8b8d-41f5-8858-79040546a97e req-addd0e1a-35f6-46e6-90fe-49715dd37e47 service nova] Creating event network-vif-deleted:1d258458-0cee-481c-93c4-bf0b858d9e28 for instance 2b1c63c9-4f4b-4c9e-91da-42f88fd63286 on hv-cinder-84617 Jul 28 18:19:48.453429 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [req-1c53e1cd-8b8d-41f5-8858-79040546a97e req-addd0e1a-35f6-46e6-90fe-49715dd37e47 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033071 Jul 28 18:19:48.454543 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 354/706] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:19:49.308393 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ed26e3b9-7520-422d-87f2-501eafb06b51 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:19:49.309143 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ed26e3b9-7520-422d-87f2-501eafb06b51 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:19:49.317675 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ed26e3b9-7520-422d-87f2-501eafb06b51 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:49.317675 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ed26e3b9-7520-422d-87f2-501eafb06b51 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:49.317675 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ed26e3b9-7520-422d-87f2-501eafb06b51 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:49.318301 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ed26e3b9-7520-422d-87f2-501eafb06b51 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:49.358350 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ed26e3b9-7520-422d-87f2-501eafb06b51 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:49.358968 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ed26e3b9-7520-422d-87f2-501eafb06b51 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:49.359896 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.objects.instance [None req-ed26e3b9-7520-422d-87f2-501eafb06b51 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lazy-loading 'fault' on Instance uuid 2b1c63c9-4f4b-4c9e-91da-42f88fd63286 {{(pid=118453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:19:49.417313 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ed26e3b9-7520-422d-87f2-501eafb06b51 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:19:49.433853 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ed26e3b9-7520-422d-87f2-501eafb06b51 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:19:49.438026 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ed26e3b9-7520-422d-87f2-501eafb06b51 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:19:49.443774 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ed26e3b9-7520-422d-87f2-501eafb06b51 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 200 len: 1370 microversion: 2.20 time: 0.139178 Jul 28 18:19:49.444680 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 353/707] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:19:49 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 1370 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:19:50.468898 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-e2710e99-0082-4df5-aacd-38c5ec96f3f2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:19:50.469640 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-e2710e99-0082-4df5-aacd-38c5ec96f3f2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:19:50.475890 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e2710e99-0082-4df5-aacd-38c5ec96f3f2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:50.476347 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e2710e99-0082-4df5-aacd-38c5ec96f3f2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:50.477139 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e2710e99-0082-4df5-aacd-38c5ec96f3f2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:50.477585 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e2710e99-0082-4df5-aacd-38c5ec96f3f2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:50.490500 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.wsgi [None req-e2710e99-0082-4df5-aacd-38c5ec96f3f2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] HTTP exception thrown: Instance 2b1c63c9-4f4b-4c9e-91da-42f88fd63286 could not be found. Jul 28 18:19:50.492099 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-e2710e99-0082-4df5-aacd-38c5ec96f3f2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Request method failure captured: Jul 28 18:19:50.492099 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: request: GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 HTTP/1.1 Jul 28 18:19:50.492099 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Accept: application/json Jul 28 18:19:50.492099 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Accept-Encoding: identity Jul 28 18:19:50.492099 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Connection: close Jul 28 18:19:50.492099 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Content-Length: 0 Jul 28 18:19:50.492099 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Content-Type: application/json Jul 28 18:19:50.492099 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Host: 10.222.0.86 Jul 28 18:19:50.492099 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Openstack-System-Scope: None Jul 28 18:19:50.492099 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: User-Agent: python-urllib3/1.26.10 Jul 28 18:19:50.492099 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Auth-Token: gAAAAABi4tGYtri9w88fvm9LdwZ9q5eT8OemXnJrGThiFt_Jy7tnSkbCyYLecvfGGXcIDWtA5RcE8mn3rAtlD95iEejdxlDLjKdZ6FTdXo73WOMqFIz_TEcxTWtQAJ9fBowbsqs0rahQu51tqhBl7gHiC-szGsusyvQggLBcC5r-9AfeERA-cPc Jul 28 18:19:50.492099 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Domain-Id: None Jul 28 18:19:50.492099 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Domain-Name: None Jul 28 18:19:50.492099 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Identity-Status: Confirmed Jul 28 18:19:50.492099 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Is-Admin-Project: True Jul 28 18:19:50.492099 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 18:19:50.492099 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Domain-Id: default Jul 28 18:19:50.492099 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Domain-Name: Default Jul 28 18:19:50.492099 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Id: 9e962e97777048b79415ba13adcc95be Jul 28 18:19:50.492099 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-64193895 Jul 28 18:19:50.492099 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Role: member,reader Jul 28 18:19:50.492099 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Roles: member,reader Jul 28 18:19:50.493603 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_9e962e97777048b79415ba13adcc95be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/9e962e97777048b79415ba13adcc95be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/9e962e97777048b79415ba13adcc95be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/9e962e97777048b79415ba13adcc95be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}] Jul 28 18:19:50.493603 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant: tempest-AttachVolumeShelveTestJSON-64193895 Jul 28 18:19:50.493603 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant-Id: 9e962e97777048b79415ba13adcc95be Jul 28 18:19:50.493603 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-64193895 Jul 28 18:19:50.493603 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User: tempest-AttachVolumeShelveTestJSON-64193895-project Jul 28 18:19:50.493603 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Domain-Id: default Jul 28 18:19:50.493603 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Domain-Name: Default Jul 28 18:19:50.493603 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Id: ca7d773290a9483d91ebefad341addee Jul 28 18:19:50.493603 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Name: tempest-AttachVolumeShelveTestJSON-64193895-project Jul 28 18:19:50.493603 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: method: > Jul 28 18:19:50.493603 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: exception: Instance 2b1c63c9-4f4b-4c9e-91da-42f88fd63286 could not be found. Jul 28 18:19:50.493603 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: action_args: {'id': '2b1c63c9-4f4b-4c9e-91da-42f88fd63286'} Jul 28 18:19:50.494452 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:19:50.494452 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:19:50.494452 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:19:50.494452 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:19:50.494452 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:19:50.494452 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:19:50.494452 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:19:50.494452 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:19:50.494452 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:19:50.494452 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:19:50.494452 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b1c63c9-4f4b-4c9e-91da-42f88fd63286 could not be found. Jul 28 18:19:50.494452 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:19:50.494452 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:19:50.494452 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:19:50.494452 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:19:50.494452 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:19:50.494452 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:19:50.494452 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:19:50.494452 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:19:50.494452 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:19:50.495991 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:19:50.495991 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 18:19:50.495991 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 18:19:50.495991 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:19:50.495991 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:19:50.495991 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:19:50.495991 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:19:50.495991 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b1c63c9-4f4b-4c9e-91da-42f88fd63286 could not be found. Jul 28 18:19:50.495991 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:19:50.495991 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:19:50.495991 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:19:50.495991 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:19:50.495991 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:19:50.495991 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:19:50.495991 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:19:50.495991 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:19:50.495991 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b1c63c9-4f4b-4c9e-91da-42f88fd63286 could not be found. Jul 28 18:19:50.495991 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:19:50.497486 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-e2710e99-0082-4df5-aacd-38c5ec96f3f2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Returning 404 to user: Instance 2b1c63c9-4f4b-4c9e-91da-42f88fd63286 could not be found. {{(pid=118454) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:19:50.497486 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-e2710e99-0082-4df5-aacd-38c5ec96f3f2 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 404 len: 111 microversion: 2.20 time: 0.029672 Jul 28 18:19:50.497486 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 355/708] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:19:50 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 18:19:50.502902 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-64436a81-43ff-4af6-b706-63dfd5bc62c7 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '.version_select at 0x7f6fe258ddc0>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:19:50.507383 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR oslo.messaging._drivers.impl_rabbit [None req-64436a81-43ff-4af6-b706-63dfd5bc62c7 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [7a25c615-497b-41dc-91f1-137b33764f9e] AMQP server on 10.222.0.86:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 28 18:19:51.515061 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO oslo.messaging._drivers.impl_rabbit [None req-64436a81-43ff-4af6-b706-63dfd5bc62c7 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [7a25c615-497b-41dc-91f1-137b33764f9e] Reconnected to AMQP server on 10.222.0.86:5672 via [amqp] client with port 52218. Jul 28 18:19:51.595357 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-64436a81-43ff-4af6-b706-63dfd5bc62c7 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-777318939" status: 204 len: 0 microversion: 2.20 time: 1.096220 Jul 28 18:19:51.595941 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 354/709] 10.222.0.86 () {60 vars in 1259 bytes} [Thu Jul 28 18:19:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-777318939 => generated 0 bytes in 1098 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 28 18:19:52.377068 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-6d1838a0-3763-4fcf-8a8e-de0ecd7c59ce tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Action: 'create', calling method: .version_select at 0x7f6fe24258b0>, body: {"keypair": {"name": "tempest-keypair-1362015628", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2SoKyIqA50jGD51Af9lt57luZMOJg/YqNh4CtuClXqbNAK6LUjJhHl8tI/Vzumys3y46ghOKpPG4EdGNb8FeLxRX1r9tfgskDGd3r1VGW5XgrYt59KZ0vSdVa21KmIOQ=="}} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:19:52.393093 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.quota [None req-6d1838a0-3763-4fcf-8a8e-de0ecd7c59ce tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Getting quotas for project 9e962e97777048b79415ba13adcc95be. Resources: {'key_pairs'} {{(pid=118454) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 18:19:52.396839 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.quota [None req-6d1838a0-3763-4fcf-8a8e-de0ecd7c59ce tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Getting quotas for user ca7d773290a9483d91ebefad341addee and project 9e962e97777048b79415ba13adcc95be. Resources: {'key_pairs'} {{(pid=118454) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 18:19:52.409014 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6d1838a0-3763-4fcf-8a8e-de0ecd7c59ce tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [1f036f57-13ae-4f9e-b66e-a4a1464a984c] AMQP server on 10.222.0.86:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 28 18:19:53.415835 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO oslo.messaging._drivers.impl_rabbit [None req-6d1838a0-3763-4fcf-8a8e-de0ecd7c59ce tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [1f036f57-13ae-4f9e-b66e-a4a1464a984c] Reconnected to AMQP server on 10.222.0.86:5672 via [amqp] client with port 52232. Jul 28 18:19:53.493640 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-6d1838a0-3763-4fcf-8a8e-de0ecd7c59ce tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.120524 Jul 28 18:19:53.494243 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 356/710] 10.222.0.86 () {62 vars in 1200 bytes} [Thu Jul 28 18:19:52 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1122 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 28 18:19:55.621234 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d5d28d08-3ac9-44e7-a1e2-b4f7897a518d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1915828394", "imageRef": "61912422-61cd-4ced-a573-85ee305e010f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0082d454-46e3-4fac-a205-e12b0fa3a60d"}], "security_groups": [{"name": "tempest-securitygroup--1449784284"}], "key_name": "tempest-keypair-1362015628", "user_data": "}} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:19:55.722195 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.network.neutron [None req-d5d28d08-3ac9-44e7-a1e2-b4f7897a518d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] validate_networks() for [('0082d454-46e3-4fac-a205-e12b0fa3a60d', None, None, None, None, None)] {{(pid=118453) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 18:19:56.141681 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-d5d28d08-3ac9-44e7-a1e2-b4f7897a518d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Flavor limits 0:0:0 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 18:19:56.142153 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-d5d28d08-3ac9-44e7-a1e2-b4f7897a518d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Image limits 0:0:0 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 18:19:56.142678 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-d5d28d08-3ac9-44e7-a1e2-b4f7897a518d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Flavor pref 0:0:0 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 18:19:56.143280 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-d5d28d08-3ac9-44e7-a1e2-b4f7897a518d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Image pref 0:0:0 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 18:19:56.143724 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-d5d28d08-3ac9-44e7-a1e2-b4f7897a518d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 18:19:56.152693 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d5d28d08-3ac9-44e7-a1e2-b4f7897a518d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:56.153171 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d5d28d08-3ac9-44e7-a1e2-b4f7897a518d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:56.154030 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d5d28d08-3ac9-44e7-a1e2-b4f7897a518d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:19:56.154467 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d5d28d08-3ac9-44e7-a1e2-b4f7897a518d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:19:56.171797 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.quota [None req-d5d28d08-3ac9-44e7-a1e2-b4f7897a518d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Getting quotas for project 9e962e97777048b79415ba13adcc95be. Resources: {'cores', 'ram', 'instances'} {{(pid=118453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 18:19:56.175669 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.quota [None req-d5d28d08-3ac9-44e7-a1e2-b4f7897a518d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Getting quotas for user ca7d773290a9483d91ebefad341addee and project 9e962e97777048b79415ba13adcc95be. Resources: {'cores', 'ram', 'instances'} {{(pid=118453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 18:19:56.187256 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-d5d28d08-3ac9-44e7-a1e2-b4f7897a518d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Going to run 1 instances... {{(pid=118453) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 18:19:56.191208 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-d5d28d08-3ac9-44e7-a1e2-b4f7897a518d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='61912422-61cd-4ced-a573-85ee305e010f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 18:19:56.299033 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d5d28d08-3ac9-44e7-a1e2-b4f7897a518d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [9fc507cb-62e6-46b0-96e5-cba623eafec2] AMQP server on 10.222.0.86:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 28 18:19:57.306478 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO oslo.messaging._drivers.impl_rabbit [None req-d5d28d08-3ac9-44e7-a1e2-b4f7897a518d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [9fc507cb-62e6-46b0-96e5-cba623eafec2] Reconnected to AMQP server on 10.222.0.86:5672 via [amqp] client with port 52256. Jul 28 18:19:57.310381 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-d5d28d08-3ac9-44e7-a1e2-b4f7897a518d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.694289 Jul 28 18:19:57.311025 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 355/711] 10.222.0.86 () {62 vars in 1188 bytes} [Thu Jul 28 18:19:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 1695 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 28 18:19:57.322664 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-0f72b6b1-7a4c-4fad-afbf-dee7d98412fc tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:19:57.323271 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-0f72b6b1-7a4c-4fad-afbf-dee7d98412fc tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:19:57.377676 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-0f72b6b1-7a4c-4fad-afbf-dee7d98412fc tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:19:57.384771 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-0f72b6b1-7a4c-4fad-afbf-dee7d98412fc tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:19:57.386286 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-0f72b6b1-7a4c-4fad-afbf-dee7d98412fc tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:19:57.387383 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-0f72b6b1-7a4c-4fad-afbf-dee7d98412fc tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1282 microversion: 2.20 time: 0.069422 Jul 28 18:19:57.387924 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 357/712] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:19:57 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1282 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:19:58.410302 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-01f8c45c-a6bf-40c2-a8ad-84cd3a203526 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:19:58.410916 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-01f8c45c-a6bf-40c2-a8ad-84cd3a203526 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:19:58.467296 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-01f8c45c-a6bf-40c2-a8ad-84cd3a203526 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:19:58.474515 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-01f8c45c-a6bf-40c2-a8ad-84cd3a203526 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:19:58.476001 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-01f8c45c-a6bf-40c2-a8ad-84cd3a203526 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:19:58.477114 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-01f8c45c-a6bf-40c2-a8ad-84cd3a203526 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1282 microversion: 2.20 time: 0.071190 Jul 28 18:19:58.477662 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 356/713] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:19:58 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1282 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:19:59.503659 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-4728f935-68f4-4524-95be-83bd3154382a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:19:59.504383 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-4728f935-68f4-4524-95be-83bd3154382a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:19:59.556341 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-4728f935-68f4-4524-95be-83bd3154382a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:19:59.564573 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-4728f935-68f4-4524-95be-83bd3154382a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:19:59.566186 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-4728f935-68f4-4524-95be-83bd3154382a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:19:59.567259 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-4728f935-68f4-4524-95be-83bd3154382a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1282 microversion: 2.20 time: 0.067417 Jul 28 18:19:59.567809 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 358/714] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:19:59 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1282 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:20:00.588917 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-4bb3e70f-4cfe-4c2b-831c-b63554c7fa60 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:20:00.589591 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-4bb3e70f-4cfe-4c2b-831c-b63554c7fa60 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:20:00.641478 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-4bb3e70f-4cfe-4c2b-831c-b63554c7fa60 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:00.648581 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-4bb3e70f-4cfe-4c2b-831c-b63554c7fa60 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:00.650127 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-4bb3e70f-4cfe-4c2b-831c-b63554c7fa60 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:00.651211 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-4bb3e70f-4cfe-4c2b-831c-b63554c7fa60 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1282 microversion: 2.20 time: 0.066233 Jul 28 18:20:00.651764 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 357/715] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:20:00 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1282 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:20:01.674522 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-9b214893-d9e9-4066-a909-a5022d1c61ad tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:20:01.675170 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-9b214893-d9e9-4066-a909-a5022d1c61ad tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:20:01.677124 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell1:SELECT=34 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:20:01.682403 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-9b214893-d9e9-4066-a909-a5022d1c61ad tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:01.690720 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-9b214893-d9e9-4066-a909-a5022d1c61ad tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:01.690720 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-9b214893-d9e9-4066-a909-a5022d1c61ad tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:01.690720 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-9b214893-d9e9-4066-a909-a5022d1c61ad tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:01.744457 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-9b214893-d9e9-4066-a909-a5022d1c61ad tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:01.752160 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-9b214893-d9e9-4066-a909-a5022d1c61ad tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:01.753700 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-9b214893-d9e9-4066-a909-a5022d1c61ad tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:01.754786 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-9b214893-d9e9-4066-a909-a5022d1c61ad tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1286 microversion: 2.20 time: 0.084823 Jul 28 18:20:01.755331 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 359/716] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:20:01 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1286 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:20:02.776329 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-6b2bf51e-b558-46b0-9d1e-303c31b7695a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:20:02.776945 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-6b2bf51e-b558-46b0-9d1e-303c31b7695a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:20:02.784171 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6b2bf51e-b558-46b0-9d1e-303c31b7695a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:02.784659 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6b2bf51e-b558-46b0-9d1e-303c31b7695a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:02.785504 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6b2bf51e-b558-46b0-9d1e-303c31b7695a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:02.785988 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6b2bf51e-b558-46b0-9d1e-303c31b7695a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:02.849943 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-6b2bf51e-b558-46b0-9d1e-303c31b7695a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:02.858546 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-6b2bf51e-b558-46b0-9d1e-303c31b7695a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:02.863246 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-6b2bf51e-b558-46b0-9d1e-303c31b7695a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:02.863246 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-6b2bf51e-b558-46b0-9d1e-303c31b7695a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1278 microversion: 2.20 time: 0.088683 Jul 28 18:20:02.863246 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 358/717] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:20:02 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1278 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:20:03.883695 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-e0604349-f974-4669-ae6e-1d2629636640 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:20:03.884342 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-e0604349-f974-4669-ae6e-1d2629636640 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:20:03.890853 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e0604349-f974-4669-ae6e-1d2629636640 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:03.891341 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e0604349-f974-4669-ae6e-1d2629636640 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:03.892131 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e0604349-f974-4669-ae6e-1d2629636640 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:03.892562 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e0604349-f974-4669-ae6e-1d2629636640 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:03.957970 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-e0604349-f974-4669-ae6e-1d2629636640 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:03.966436 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-e0604349-f974-4669-ae6e-1d2629636640 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:03.968511 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-e0604349-f974-4669-ae6e-1d2629636640 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:03.969642 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-e0604349-f974-4669-ae6e-1d2629636640 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1340 microversion: 2.20 time: 0.090122 Jul 28 18:20:03.970248 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 360/718] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:20:03 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1340 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:20:04.993499 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b15cfb28-bf4f-4594-a4ad-985f6e726102 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:20:04.994775 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b15cfb28-bf4f-4594-a4ad-985f6e726102 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:20:05.008400 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b15cfb28-bf4f-4594-a4ad-985f6e726102 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:05.008892 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b15cfb28-bf4f-4594-a4ad-985f6e726102 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:05.009750 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b15cfb28-bf4f-4594-a4ad-985f6e726102 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:05.010130 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b15cfb28-bf4f-4594-a4ad-985f6e726102 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:05.157325 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b15cfb28-bf4f-4594-a4ad-985f6e726102 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:05.168427 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [req-6461ff4f-f114-476d-93d7-ca27595137d8 req-2b49a792-ba71-4348-b317-8f5520a54340 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f14e236-1f43-4ff7-bf3d-ae1f6a084b82", "tag": "0069c542-1991-42af-bff0-348765fbb55f"}]} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:20:05.182138 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b15cfb28-bf4f-4594-a4ad-985f6e726102 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:05.185017 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-6461ff4f-f114-476d-93d7-ca27595137d8 req-2b49a792-ba71-4348-b317-8f5520a54340 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:05.185969 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b15cfb28-bf4f-4594-a4ad-985f6e726102 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:05.187591 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-6461ff4f-f114-476d-93d7-ca27595137d8 req-2b49a792-ba71-4348-b317-8f5520a54340 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:05.191971 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b15cfb28-bf4f-4594-a4ad-985f6e726102 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1408 microversion: 2.20 time: 0.198184 Jul 28 18:20:05.192652 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 359/719] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:20:04 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1408 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:20:05.217446 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.compute.server_external_events [req-6461ff4f-f114-476d-93d7-ca27595137d8 req-2b49a792-ba71-4348-b317-8f5520a54340 service nova] Creating event network-changed:0069c542-1991-42af-bff0-348765fbb55f for instance 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 on hv-cinder-84617 Jul 28 18:20:05.222931 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [req-6461ff4f-f114-476d-93d7-ca27595137d8 req-2b49a792-ba71-4348-b317-8f5520a54340 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058889 Jul 28 18:20:05.223959 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 361/720] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:20:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:20:06.215042 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d8efbd42-a595-40fc-bf31-71090c43e8b1 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:20:06.215612 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-d8efbd42-a595-40fc-bf31-71090c43e8b1 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:20:06.218108 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell0:SELECT=2 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:20:06.223279 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d8efbd42-a595-40fc-bf31-71090c43e8b1 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:06.223726 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d8efbd42-a595-40fc-bf31-71090c43e8b1 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:06.224489 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d8efbd42-a595-40fc-bf31-71090c43e8b1 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:06.224930 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d8efbd42-a595-40fc-bf31-71090c43e8b1 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:06.361940 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-d8efbd42-a595-40fc-bf31-71090c43e8b1 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:06.370256 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-d8efbd42-a595-40fc-bf31-71090c43e8b1 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:06.371763 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-d8efbd42-a595-40fc-bf31-71090c43e8b1 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:06.373406 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-d8efbd42-a595-40fc-bf31-71090c43e8b1 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1408 microversion: 2.20 time: 0.162079 Jul 28 18:20:06.373968 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 360/721] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:20:06 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1408 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:20:07.396599 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-579947a3-4066-4a95-b6f9-f52c49b0990f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:20:07.397251 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-579947a3-4066-4a95-b6f9-f52c49b0990f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:20:07.404128 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-579947a3-4066-4a95-b6f9-f52c49b0990f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:07.404586 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-579947a3-4066-4a95-b6f9-f52c49b0990f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:07.405410 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-579947a3-4066-4a95-b6f9-f52c49b0990f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:07.405855 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-579947a3-4066-4a95-b6f9-f52c49b0990f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:07.532378 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-579947a3-4066-4a95-b6f9-f52c49b0990f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:07.540981 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-579947a3-4066-4a95-b6f9-f52c49b0990f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:07.542489 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-579947a3-4066-4a95-b6f9-f52c49b0990f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:07.543587 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-579947a3-4066-4a95-b6f9-f52c49b0990f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1408 microversion: 2.20 time: 0.151368 Jul 28 18:20:07.544142 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 362/722] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:20:07 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1408 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:20:08.567984 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f18bcb37-5900-42a1-a543-c128be8da3b1 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:20:08.568508 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f18bcb37-5900-42a1-a543-c128be8da3b1 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:20:08.574929 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f18bcb37-5900-42a1-a543-c128be8da3b1 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:08.575374 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f18bcb37-5900-42a1-a543-c128be8da3b1 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:08.576719 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f18bcb37-5900-42a1-a543-c128be8da3b1 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:08.577177 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f18bcb37-5900-42a1-a543-c128be8da3b1 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:08.704444 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f18bcb37-5900-42a1-a543-c128be8da3b1 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:08.712428 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f18bcb37-5900-42a1-a543-c128be8da3b1 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:08.713946 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f18bcb37-5900-42a1-a543-c128be8da3b1 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:08.715287 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f18bcb37-5900-42a1-a543-c128be8da3b1 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1408 microversion: 2.20 time: 0.151487 Jul 28 18:20:08.715833 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 361/723] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:20:08 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1408 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:20:09.737775 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-a0510cfd-8297-42c4-906a-587eeeefb30a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:20:09.738354 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-a0510cfd-8297-42c4-906a-587eeeefb30a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:20:09.740720 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell0:SELECT=8 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:20:09.745499 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a0510cfd-8297-42c4-906a-587eeeefb30a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:09.745948 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a0510cfd-8297-42c4-906a-587eeeefb30a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:09.746735 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a0510cfd-8297-42c4-906a-587eeeefb30a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:09.747175 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a0510cfd-8297-42c4-906a-587eeeefb30a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:09.880311 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-a0510cfd-8297-42c4-906a-587eeeefb30a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:09.888328 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-a0510cfd-8297-42c4-906a-587eeeefb30a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:09.890481 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-a0510cfd-8297-42c4-906a-587eeeefb30a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:09.891579 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-a0510cfd-8297-42c4-906a-587eeeefb30a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1408 microversion: 2.20 time: 0.157802 Jul 28 18:20:09.892267 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 363/724] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:20:09 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:20:10.913923 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-14b371b1-37e2-46dc-863a-d0c7c1106415 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:20:10.914530 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-14b371b1-37e2-46dc-863a-d0c7c1106415 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:20:10.916609 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell0:SELECT=10 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:20:10.921574 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-14b371b1-37e2-46dc-863a-d0c7c1106415 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:10.922015 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-14b371b1-37e2-46dc-863a-d0c7c1106415 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:10.922767 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-14b371b1-37e2-46dc-863a-d0c7c1106415 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:10.923258 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-14b371b1-37e2-46dc-863a-d0c7c1106415 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:11.057933 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-14b371b1-37e2-46dc-863a-d0c7c1106415 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:11.060098 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-14b371b1-37e2-46dc-863a-d0c7c1106415 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:11.061680 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-14b371b1-37e2-46dc-863a-d0c7c1106415 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:11.062780 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-14b371b1-37e2-46dc-863a-d0c7c1106415 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1408 microversion: 2.20 time: 0.152930 Jul 28 18:20:11.063335 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 362/725] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:20:10 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:20:11.713990 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [req-498884d2-9e7e-4245-99dc-1843ce58fb98 req-aaf1d987-d37c-4c5a-a892-f61d035c6291 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f14e236-1f43-4ff7-bf3d-ae1f6a084b82", "name": "network-vif-plugged", "status": "completed", "tag": "0069c542-1991-42af-bff0-348765fbb55f"}]} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:20:11.721077 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:20:11.724918 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-498884d2-9e7e-4245-99dc-1843ce58fb98 req-aaf1d987-d37c-4c5a-a892-f61d035c6291 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:11.725461 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-498884d2-9e7e-4245-99dc-1843ce58fb98 req-aaf1d987-d37c-4c5a-a892-f61d035c6291 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:11.736227 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.compute.server_external_events [req-498884d2-9e7e-4245-99dc-1843ce58fb98 req-aaf1d987-d37c-4c5a-a892-f61d035c6291 service nova] Creating event network-vif-plugged:0069c542-1991-42af-bff0-348765fbb55f for instance 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 on hv-cinder-84617 Jul 28 18:20:11.748117 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [req-498884d2-9e7e-4245-99dc-1843ce58fb98 req-aaf1d987-d37c-4c5a-a892-f61d035c6291 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037964 Jul 28 18:20:11.748755 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 364/726] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:20:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:20:12.085905 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ceb9b2be-1b67-4b54-941e-1e6047510792 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:20:12.086527 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ceb9b2be-1b67-4b54-941e-1e6047510792 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:20:12.089013 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:20:12.094734 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ceb9b2be-1b67-4b54-941e-1e6047510792 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:12.095341 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ceb9b2be-1b67-4b54-941e-1e6047510792 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:12.101985 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ceb9b2be-1b67-4b54-941e-1e6047510792 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:12.101985 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ceb9b2be-1b67-4b54-941e-1e6047510792 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:12.101985 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=82,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:20:12.229797 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ceb9b2be-1b67-4b54-941e-1e6047510792 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:12.237484 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ceb9b2be-1b67-4b54-941e-1e6047510792 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:12.238994 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ceb9b2be-1b67-4b54-941e-1e6047510792 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:12.240099 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ceb9b2be-1b67-4b54-941e-1e6047510792 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1408 microversion: 2.20 time: 0.158158 Jul 28 18:20:12.240651 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 363/727] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:20:12 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:20:13.264354 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-1fe02c89-29fa-418f-85df-ffe3e17e0b37 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:20:13.265101 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-1fe02c89-29fa-418f-85df-ffe3e17e0b37 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:20:13.271764 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-1fe02c89-29fa-418f-85df-ffe3e17e0b37 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:13.272211 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-1fe02c89-29fa-418f-85df-ffe3e17e0b37 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:13.272993 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-1fe02c89-29fa-418f-85df-ffe3e17e0b37 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:13.273428 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-1fe02c89-29fa-418f-85df-ffe3e17e0b37 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:13.401425 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-1fe02c89-29fa-418f-85df-ffe3e17e0b37 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:13.409591 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-1fe02c89-29fa-418f-85df-ffe3e17e0b37 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:13.411110 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-1fe02c89-29fa-418f-85df-ffe3e17e0b37 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:13.412214 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-1fe02c89-29fa-418f-85df-ffe3e17e0b37 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1408 microversion: 2.20 time: 0.152926 Jul 28 18:20:13.412771 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 365/728] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:20:13 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:20:14.434131 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3113cc7e-f60b-40ca-b57c-d09895ebc7f9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:20:14.434747 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3113cc7e-f60b-40ca-b57c-d09895ebc7f9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:20:14.442737 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3113cc7e-f60b-40ca-b57c-d09895ebc7f9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:14.443191 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3113cc7e-f60b-40ca-b57c-d09895ebc7f9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:14.443953 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3113cc7e-f60b-40ca-b57c-d09895ebc7f9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:14.444392 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3113cc7e-f60b-40ca-b57c-d09895ebc7f9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:14.574661 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-3113cc7e-f60b-40ca-b57c-d09895ebc7f9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:14.583531 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-3113cc7e-f60b-40ca-b57c-d09895ebc7f9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:14.585096 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-3113cc7e-f60b-40ca-b57c-d09895ebc7f9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:14.589886 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-3113cc7e-f60b-40ca-b57c-d09895ebc7f9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1599 microversion: 2.20 time: 0.156051 Jul 28 18:20:14.589886 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 364/729] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:20:14 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:20:14.608459 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-5cc61da6-4e45-49b6-8d34-f06813f15af4 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:20:14.620214 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-5cc61da6-4e45-49b6-8d34-f06813f15af4 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:20:14.620214 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-5cc61da6-4e45-49b6-8d34-f06813f15af4 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:14.620214 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-5cc61da6-4e45-49b6-8d34-f06813f15af4 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:14.620214 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-5cc61da6-4e45-49b6-8d34-f06813f15af4 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:14.620609 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-5cc61da6-4e45-49b6-8d34-f06813f15af4 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:14.693405 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-5cc61da6-4e45-49b6-8d34-f06813f15af4 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.088841 Jul 28 18:20:14.693996 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 366/730] 10.222.0.86 () {60 vars in 1316 bytes} [Thu Jul 28 18:20:14 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 18:20:15.703157 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a60a9075-dced-4c7a-a40b-531d2fe0e50e tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:20:15.703696 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-a60a9075-dced-4c7a-a40b-531d2fe0e50e tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 39af8515-9818-4664-9e32-7a8a318f02c6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:20:15.710419 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a60a9075-dced-4c7a-a40b-531d2fe0e50e tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:15.710866 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a60a9075-dced-4c7a-a40b-531d2fe0e50e tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:15.711628 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a60a9075-dced-4c7a-a40b-531d2fe0e50e tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:15.712060 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a60a9075-dced-4c7a-a40b-531d2fe0e50e tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:15.793629 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.objects.instance [None req-a60a9075-dced-4c7a-a40b-531d2fe0e50e tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lazy-loading 'services' on Instance uuid 39af8515-9818-4664-9e32-7a8a318f02c6 {{(pid=118453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:20:15.892714 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [req-91093bd6-0880-4003-b6f8-2c6f274a4f56 req-257b8572-0d81-4124-be1f-6823be2d3136 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f14e236-1f43-4ff7-bf3d-ae1f6a084b82", "tag": "0069c542-1991-42af-bff0-348765fbb55f"}]} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:20:15.902653 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-91093bd6-0880-4003-b6f8-2c6f274a4f56 req-257b8572-0d81-4124-be1f-6823be2d3136 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:15.903029 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-91093bd6-0880-4003-b6f8-2c6f274a4f56 req-257b8572-0d81-4124-be1f-6823be2d3136 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:15.915052 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.compute.server_external_events [req-91093bd6-0880-4003-b6f8-2c6f274a4f56 req-257b8572-0d81-4124-be1f-6823be2d3136 service nova] Creating event network-changed:0069c542-1991-42af-bff0-348765fbb55f for instance 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 on hv-cinder-84617 Jul 28 18:20:15.921145 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [req-91093bd6-0880-4003-b6f8-2c6f274a4f56 req-257b8572-0d81-4124-be1f-6823be2d3136 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032649 Jul 28 18:20:15.921739 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 367/731] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:20:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 18:20:15.984707 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-a60a9075-dced-4c7a-a40b-531d2fe0e50e tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "DELETE /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6/os-volume_attachments/5f35737c-241c-4033-938c-f0a90723fbba" status: 202 len: 0 microversion: 2.1 time: 0.285637 Jul 28 18:20:15.985534 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 365/732] 10.222.0.86 () {58 vars in 1416 bytes} [Thu Jul 28 18:20:15 2022] DELETE /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6/os-volume_attachments/5f35737c-241c-4033-938c-f0a90723fbba => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 18:20:15.994973 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-a4de5dd1-170c-4061-a0fa-55a8cf6274d0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:20:15.998094 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-a4de5dd1-170c-4061-a0fa-55a8cf6274d0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 39af8515-9818-4664-9e32-7a8a318f02c6] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:20:16.005949 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a4de5dd1-170c-4061-a0fa-55a8cf6274d0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:16.006490 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a4de5dd1-170c-4061-a0fa-55a8cf6274d0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:16.007503 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a4de5dd1-170c-4061-a0fa-55a8cf6274d0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:16.008346 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a4de5dd1-170c-4061-a0fa-55a8cf6274d0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:16.041232 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-a4de5dd1-170c-4061-a0fa-55a8cf6274d0 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051030 Jul 28 18:20:16.042120 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 368/733] 10.222.0.86 () {58 vars in 1302 bytes} [Thu Jul 28 18:20:15 2022] GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:20:17.055423 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a5e14d68-f57f-47a4-89b0-22f230e13b66 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:20:17.057859 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-a5e14d68-f57f-47a4-89b0-22f230e13b66 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 39af8515-9818-4664-9e32-7a8a318f02c6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:20:17.065425 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a5e14d68-f57f-47a4-89b0-22f230e13b66 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:17.065876 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a5e14d68-f57f-47a4-89b0-22f230e13b66 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:17.066687 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a5e14d68-f57f-47a4-89b0-22f230e13b66 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:17.067122 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a5e14d68-f57f-47a4-89b0-22f230e13b66 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:17.098089 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-a5e14d68-f57f-47a4-89b0-22f230e13b66 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047026 Jul 28 18:20:17.098645 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 366/734] 10.222.0.86 () {58 vars in 1302 bytes} [Thu Jul 28 18:20:17 2022] GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:20:18.110618 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-a9940ffe-ec67-4ceb-a886-6768abbe6fe2 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:20:18.114221 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-a9940ffe-ec67-4ceb-a886-6768abbe6fe2 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 39af8515-9818-4664-9e32-7a8a318f02c6] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:20:18.119220 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a9940ffe-ec67-4ceb-a886-6768abbe6fe2 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:18.119664 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a9940ffe-ec67-4ceb-a886-6768abbe6fe2 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:18.120416 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a9940ffe-ec67-4ceb-a886-6768abbe6fe2 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:18.120844 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a9940ffe-ec67-4ceb-a886-6768abbe6fe2 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:18.150599 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-a9940ffe-ec67-4ceb-a886-6768abbe6fe2 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044419 Jul 28 18:20:18.151135 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 369/735] 10.222.0.86 () {58 vars in 1302 bytes} [Thu Jul 28 18:20:18 2022] GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 18:20:18.226258 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-86b7cb63-c49c-4781-9d83-144bcfcf9dce tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:20:18.226791 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-86b7cb63-c49c-4781-9d83-144bcfcf9dce tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 39af8515-9818-4664-9e32-7a8a318f02c6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:20:18.233750 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-86b7cb63-c49c-4781-9d83-144bcfcf9dce tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:18.234205 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-86b7cb63-c49c-4781-9d83-144bcfcf9dce tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:18.234968 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-86b7cb63-c49c-4781-9d83-144bcfcf9dce tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:18.235408 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-86b7cb63-c49c-4781-9d83-144bcfcf9dce tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:18.259574 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-86b7cb63-c49c-4781-9d83-144bcfcf9dce tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 39af8515-9818-4664-9e32-7a8a318f02c6] Going to try to terminate instance {{(pid=118453) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 18:20:18.542769 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-86b7cb63-c49c-4781-9d83-144bcfcf9dce tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "DELETE /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6" status: 204 len: 0 microversion: 2.1 time: 0.320017 Jul 28 18:20:18.543347 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 367/736] 10.222.0.86 () {58 vars in 1239 bytes} [Thu Jul 28 18:20:18 2022] DELETE /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 18:20:18.551900 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-914d2959-cb7e-4071-af97-246643e0c192 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:20:18.552584 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-914d2959-cb7e-4071-af97-246643e0c192 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 39af8515-9818-4664-9e32-7a8a318f02c6] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:20:18.558660 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-914d2959-cb7e-4071-af97-246643e0c192 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:18.559109 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-914d2959-cb7e-4071-af97-246643e0c192 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:18.559868 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-914d2959-cb7e-4071-af97-246643e0c192 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:18.560305 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-914d2959-cb7e-4071-af97-246643e0c192 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:18.687753 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-914d2959-cb7e-4071-af97-246643e0c192 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:18.695213 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-914d2959-cb7e-4071-af97-246643e0c192 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6" status: 200 len: 1690 microversion: 2.1 time: 0.147098 Jul 28 18:20:18.695779 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 370/737] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:20:18 2022] GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6 => generated 1690 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:20:19.716951 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-7efbdf7b-5165-40bd-893f-ee4fe85044d1 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:20:19.717616 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-7efbdf7b-5165-40bd-893f-ee4fe85044d1 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 39af8515-9818-4664-9e32-7a8a318f02c6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:20:19.724352 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7efbdf7b-5165-40bd-893f-ee4fe85044d1 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:19.724805 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7efbdf7b-5165-40bd-893f-ee4fe85044d1 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:19.725607 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7efbdf7b-5165-40bd-893f-ee4fe85044d1 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:19.726085 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7efbdf7b-5165-40bd-893f-ee4fe85044d1 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:19.860952 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-7efbdf7b-5165-40bd-893f-ee4fe85044d1 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:19.868532 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-7efbdf7b-5165-40bd-893f-ee4fe85044d1 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6" status: 200 len: 1690 microversion: 2.1 time: 0.156215 Jul 28 18:20:19.871560 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 368/738] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:20:19 2022] GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6 => generated 1690 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:20:20.890057 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-166b700c-f2af-435e-916a-64d28e0e1d83 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:20:20.890668 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-166b700c-f2af-435e-916a-64d28e0e1d83 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 39af8515-9818-4664-9e32-7a8a318f02c6] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:20:20.897275 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-166b700c-f2af-435e-916a-64d28e0e1d83 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:20.897733 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-166b700c-f2af-435e-916a-64d28e0e1d83 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:20.898499 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-166b700c-f2af-435e-916a-64d28e0e1d83 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:20.898941 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-166b700c-f2af-435e-916a-64d28e0e1d83 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:21.026080 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-166b700c-f2af-435e-916a-64d28e0e1d83 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:21.034227 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-166b700c-f2af-435e-916a-64d28e0e1d83 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6" status: 200 len: 1690 microversion: 2.1 time: 0.148015 Jul 28 18:20:21.034790 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 371/739] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:20:20 2022] GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6 => generated 1690 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:20:22.055707 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-c4c23fe9-17f7-4f17-bf54-e873a4eade00 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:20:22.056325 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-c4c23fe9-17f7-4f17-bf54-e873a4eade00 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 39af8515-9818-4664-9e32-7a8a318f02c6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:20:22.063073 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c4c23fe9-17f7-4f17-bf54-e873a4eade00 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:22.063522 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c4c23fe9-17f7-4f17-bf54-e873a4eade00 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:22.064291 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c4c23fe9-17f7-4f17-bf54-e873a4eade00 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:22.064736 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c4c23fe9-17f7-4f17-bf54-e873a4eade00 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:22.198274 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-c4c23fe9-17f7-4f17-bf54-e873a4eade00 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:22.206371 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-c4c23fe9-17f7-4f17-bf54-e873a4eade00 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6" status: 200 len: 1690 microversion: 2.1 time: 0.154520 Jul 28 18:20:22.206928 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 369/740] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:20:22 2022] GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6 => generated 1690 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:20:22.670444 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-a8896e94-5b51-484e-b596-eb6797674a14 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:20:22.672581 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-a8896e94-5b51-484e-b596-eb6797674a14 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:20:22.679002 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a8896e94-5b51-484e-b596-eb6797674a14 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:22.679456 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a8896e94-5b51-484e-b596-eb6797674a14 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:22.680225 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a8896e94-5b51-484e-b596-eb6797674a14 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:22.680662 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a8896e94-5b51-484e-b596-eb6797674a14 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:22.709308 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-a8896e94-5b51-484e-b596-eb6797674a14 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043312 Jul 28 18:20:22.709869 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 372/741] 10.222.0.86 () {58 vars in 1302 bytes} [Thu Jul 28 18:20:22 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 18:20:22.772726 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-39098217-146d-4d18-93aa-a6ac2575774e tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:20:22.780543 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-39098217-146d-4d18-93aa-a6ac2575774e tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:20:22.780543 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-39098217-146d-4d18-93aa-a6ac2575774e tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:22.780543 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-39098217-146d-4d18-93aa-a6ac2575774e tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:22.781282 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-39098217-146d-4d18-93aa-a6ac2575774e tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:22.781725 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-39098217-146d-4d18-93aa-a6ac2575774e tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:22.806301 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-39098217-146d-4d18-93aa-a6ac2575774e tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Going to try to terminate instance {{(pid=118453) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 18:20:23.079486 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-39098217-146d-4d18-93aa-a6ac2575774e tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "DELETE /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 204 len: 0 microversion: 2.1 time: 0.310430 Jul 28 18:20:23.080191 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 370/742] 10.222.0.86 () {58 vars in 1239 bytes} [Thu Jul 28 18:20:22 2022] DELETE /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 18:20:23.088371 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-cf222c41-6237-4c52-a9bb-cba60968d2ca tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:20:23.089049 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-cf222c41-6237-4c52-a9bb-cba60968d2ca tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:20:23.095852 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-cf222c41-6237-4c52-a9bb-cba60968d2ca tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:23.104038 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-cf222c41-6237-4c52-a9bb-cba60968d2ca tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:23.104038 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-cf222c41-6237-4c52-a9bb-cba60968d2ca tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:23.104038 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-cf222c41-6237-4c52-a9bb-cba60968d2ca tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:23.231142 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-e3dd7cd7-07f0-4cfa-aa00-99eff08a5c02 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:20:23.232203 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-e3dd7cd7-07f0-4cfa-aa00-99eff08a5c02 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 39af8515-9818-4664-9e32-7a8a318f02c6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:20:23.238990 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-cf222c41-6237-4c52-a9bb-cba60968d2ca tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:23.239413 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e3dd7cd7-07f0-4cfa-aa00-99eff08a5c02 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:23.239870 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e3dd7cd7-07f0-4cfa-aa00-99eff08a5c02 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:23.240722 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e3dd7cd7-07f0-4cfa-aa00-99eff08a5c02 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:23.241190 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e3dd7cd7-07f0-4cfa-aa00-99eff08a5c02 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:23.247363 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-cf222c41-6237-4c52-a9bb-cba60968d2ca tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1673 microversion: 2.1 time: 0.162700 Jul 28 18:20:23.248884 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 373/743] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:20:23 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1673 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:20:23.254925 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [req-63fc689f-d0c5-48b3-afe7-73db5153a409 req-a1e79e0e-1f4a-40a8-a519-9e852d50e315 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39af8515-9818-4664-9e32-7a8a318f02c6", "name": "network-vif-deleted", "tag": "f0dbd9bf-00f9-4a54-976e-f94921af3d46"}]} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:20:23.265195 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-63fc689f-d0c5-48b3-afe7-73db5153a409 req-a1e79e0e-1f4a-40a8-a519-9e852d50e315 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:23.265736 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-63fc689f-d0c5-48b3-afe7-73db5153a409 req-a1e79e0e-1f4a-40a8-a519-9e852d50e315 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:23.281996 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.compute.server_external_events [req-63fc689f-d0c5-48b3-afe7-73db5153a409 req-a1e79e0e-1f4a-40a8-a519-9e852d50e315 service nova] Creating event network-vif-deleted:f0dbd9bf-00f9-4a54-976e-f94921af3d46 for instance 39af8515-9818-4664-9e32-7a8a318f02c6 on hv-cinder-84617 Jul 28 18:20:23.283548 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [req-63fc689f-d0c5-48b3-afe7-73db5153a409 req-a1e79e0e-1f4a-40a8-a519-9e852d50e315 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032780 Jul 28 18:20:23.284701 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 374/744] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:20:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:20:23.313955 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-e3dd7cd7-07f0-4cfa-aa00-99eff08a5c02 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:23.322141 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-e3dd7cd7-07f0-4cfa-aa00-99eff08a5c02 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6" status: 200 len: 1622 microversion: 2.1 time: 0.097757 Jul 28 18:20:23.323260 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 371/745] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:20:23 2022] GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6 => generated 1622 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:20:24.274694 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-ad437453-f9bb-48e3-823b-f7e40a8a2678 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:20:24.275479 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-ad437453-f9bb-48e3-823b-f7e40a8a2678 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:20:24.282835 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ad437453-f9bb-48e3-823b-f7e40a8a2678 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:24.283285 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ad437453-f9bb-48e3-823b-f7e40a8a2678 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:24.284046 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ad437453-f9bb-48e3-823b-f7e40a8a2678 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:24.284513 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ad437453-f9bb-48e3-823b-f7e40a8a2678 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:24.345595 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-34127f12-dd93-46f6-ab9d-44dd0f6c15ed tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:20:24.346224 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-34127f12-dd93-46f6-ab9d-44dd0f6c15ed tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 39af8515-9818-4664-9e32-7a8a318f02c6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:20:24.353708 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-34127f12-dd93-46f6-ab9d-44dd0f6c15ed tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:24.356740 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-34127f12-dd93-46f6-ab9d-44dd0f6c15ed tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:24.356740 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-34127f12-dd93-46f6-ab9d-44dd0f6c15ed tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:24.356740 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-34127f12-dd93-46f6-ab9d-44dd0f6c15ed tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:24.394847 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-34127f12-dd93-46f6-ab9d-44dd0f6c15ed tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:24.395395 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-34127f12-dd93-46f6-ab9d-44dd0f6c15ed tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:24.395926 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.objects.instance [None req-34127f12-dd93-46f6-ab9d-44dd0f6c15ed tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lazy-loading 'fault' on Instance uuid 39af8515-9818-4664-9e32-7a8a318f02c6 {{(pid=118453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:20:24.455914 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-34127f12-dd93-46f6-ab9d-44dd0f6c15ed tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:24.456182 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-ad437453-f9bb-48e3-823b-f7e40a8a2678 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:24.464026 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-34127f12-dd93-46f6-ab9d-44dd0f6c15ed tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6" status: 200 len: 1336 microversion: 2.1 time: 0.125214 Jul 28 18:20:24.464292 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-ad437453-f9bb-48e3-823b-f7e40a8a2678 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1673 microversion: 2.1 time: 0.195662 Jul 28 18:20:24.465055 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 372/746] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:20:24 2022] GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6 => generated 1336 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:20:24.474410 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 375/747] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:20:24 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1673 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:20:25.486816 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-883515af-0af8-46b1-8dd8-b25cf2dc1b88 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:20:25.487675 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0088b74f-4406-4cb3-b0f1-42987a95ddd6 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:20:25.488519 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0088b74f-4406-4cb3-b0f1-42987a95ddd6 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 39af8515-9818-4664-9e32-7a8a318f02c6] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:20:25.488917 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-883515af-0af8-46b1-8dd8-b25cf2dc1b88 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:20:25.495204 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0088b74f-4406-4cb3-b0f1-42987a95ddd6 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:25.496193 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-883515af-0af8-46b1-8dd8-b25cf2dc1b88 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:25.496452 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0088b74f-4406-4cb3-b0f1-42987a95ddd6 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:25.497028 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-883515af-0af8-46b1-8dd8-b25cf2dc1b88 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:25.497620 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0088b74f-4406-4cb3-b0f1-42987a95ddd6 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:25.498155 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0088b74f-4406-4cb3-b0f1-42987a95ddd6 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:25.498575 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-883515af-0af8-46b1-8dd8-b25cf2dc1b88 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:25.499165 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-883515af-0af8-46b1-8dd8-b25cf2dc1b88 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:25.519441 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.wsgi [None req-0088b74f-4406-4cb3-b0f1-42987a95ddd6 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] HTTP exception thrown: Instance 39af8515-9818-4664-9e32-7a8a318f02c6 could not be found. Jul 28 18:20:25.521335 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0088b74f-4406-4cb3-b0f1-42987a95ddd6 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Request method failure captured: Jul 28 18:20:25.521335 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: request: GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6 HTTP/1.1 Jul 28 18:20:25.521335 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Accept: application/json Jul 28 18:20:25.521335 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Accept-Encoding: identity Jul 28 18:20:25.521335 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Connection: close Jul 28 18:20:25.521335 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Content-Length: 0 Jul 28 18:20:25.521335 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Content-Type: application/json Jul 28 18:20:25.521335 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Host: 10.222.0.86 Jul 28 18:20:25.521335 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Openstack-System-Scope: None Jul 28 18:20:25.521335 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: User-Agent: python-urllib3/1.26.10 Jul 28 18:20:25.521335 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Auth-Token: gAAAAABi4tGak9iMP6i4DT42V1NnqmCZswp-XsfRnXwgZ5TInbJk7FNT9dOnhbjnqjtBLXPdrsj1TUIXXmpk6dZ3xWlxYxbYapUjkHD0Drg44UTheFQ5ZV9AjLn6l50Z1n5iufsCuAsTGkiWhMhNQDT75zNabsY87wD-531cxucsWWBAMcMaNMQ Jul 28 18:20:25.521335 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Domain-Id: None Jul 28 18:20:25.521335 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Domain-Name: None Jul 28 18:20:25.521335 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Identity-Status: Confirmed Jul 28 18:20:25.521335 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Is-Admin-Project: True Jul 28 18:20:25.521335 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Id: default Jul 28 18:20:25.521335 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Name: Default Jul 28 18:20:25.521335 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Id: b52f26ab8b934756b0c74d681d08d04f Jul 28 18:20:25.521335 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1347813421 Jul 28 18:20:25.521335 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Role: member,reader Jul 28 18:20:25.521335 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Roles: member,reader Jul 28 18:20:25.522664 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_b52f26ab8b934756b0c74d681d08d04f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/b52f26ab8b934756b0c74d681d08d04f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/b52f26ab8b934756b0c74d681d08d04f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/b52f26ab8b934756b0c74d681d08d04f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}] Jul 28 18:20:25.522664 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1347813421 Jul 28 18:20:25.522664 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant-Id: b52f26ab8b934756b0c74d681d08d04f Jul 28 18:20:25.522664 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1347813421 Jul 28 18:20:25.522664 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User: tempest-ServerRescueNegativeTestJSON-1347813421-project Jul 28 18:20:25.522664 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Id: default Jul 28 18:20:25.522664 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Name: Default Jul 28 18:20:25.522664 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Id: 5ef698c4f57f44d387550921a288d7ab Jul 28 18:20:25.522664 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1347813421-project Jul 28 18:20:25.522664 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: method: > Jul 28 18:20:25.522664 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: exception: Instance 39af8515-9818-4664-9e32-7a8a318f02c6 could not be found. Jul 28 18:20:25.522664 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: action_args: {'id': '39af8515-9818-4664-9e32-7a8a318f02c6'} Jul 28 18:20:25.523403 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:20:25.523403 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:20:25.523403 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:20:25.523403 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:20:25.523403 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:20:25.523403 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:20:25.523403 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:20:25.523403 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:20:25.523403 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:20:25.523403 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:20:25.523403 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39af8515-9818-4664-9e32-7a8a318f02c6 could not be found. Jul 28 18:20:25.523403 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:20:25.523403 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:20:25.523403 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:20:25.523403 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:20:25.523403 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:20:25.523403 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:20:25.523403 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:20:25.523403 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:20:25.523403 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:20:25.525322 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:20:25.525322 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 18:20:25.525322 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 18:20:25.525322 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:20:25.525322 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:20:25.525322 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:20:25.525322 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:20:25.525322 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39af8515-9818-4664-9e32-7a8a318f02c6 could not be found. Jul 28 18:20:25.525322 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:20:25.525322 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:20:25.525322 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:20:25.525322 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:20:25.525322 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:20:25.525322 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:20:25.525322 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:20:25.525322 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:20:25.525322 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39af8515-9818-4664-9e32-7a8a318f02c6 could not be found. Jul 28 18:20:25.525322 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:20:25.527566 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0088b74f-4406-4cb3-b0f1-42987a95ddd6 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Returning 404 to user: Instance 39af8515-9818-4664-9e32-7a8a318f02c6 could not be found. {{(pid=118453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:20:25.528484 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0088b74f-4406-4cb3-b0f1-42987a95ddd6 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6" status: 404 len: 111 microversion: 2.1 time: 0.046465 Jul 28 18:20:25.529870 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 373/748] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:20:25 2022] GET /compute/v2.1/servers/39af8515-9818-4664-9e32-7a8a318f02c6 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:20:25.534753 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-ada899af-d71c-4fa9-a241-f707dfb950be req-8ee080aa-c0d2-4b6b-be81-597c70784299 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f8c8622-dfde-4eb5-95c4-7716aebf0fcd", "name": "network-vif-deleted", "tag": "7d6f0f21-22dc-4e8d-82cd-162059368b29"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:20:25.546119 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-ada899af-d71c-4fa9-a241-f707dfb950be req-8ee080aa-c0d2-4b6b-be81-597c70784299 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:25.546668 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-ada899af-d71c-4fa9-a241-f707dfb950be req-8ee080aa-c0d2-4b6b-be81-597c70784299 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:25.563279 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-ada899af-d71c-4fa9-a241-f707dfb950be req-8ee080aa-c0d2-4b6b-be81-597c70784299 service nova] Creating event network-vif-deleted:7d6f0f21-22dc-4e8d-82cd-162059368b29 for instance 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd on hv-cinder-84617 Jul 28 18:20:25.568786 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-ada899af-d71c-4fa9-a241-f707dfb950be req-8ee080aa-c0d2-4b6b-be81-597c70784299 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037524 Jul 28 18:20:25.569972 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 374/749] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:20:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:20:25.579101 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b666210d-32ca-44d0-a28c-6ad5c4ad1546 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '.version_select at 0x7f6fe2654ee0>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:20:25.579737 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-883515af-0af8-46b1-8dd8-b25cf2dc1b88 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:25.589336 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-883515af-0af8-46b1-8dd8-b25cf2dc1b88 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1605 microversion: 2.1 time: 0.106838 Jul 28 18:20:25.590262 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 376/750] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:20:25 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1605 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:20:25.676859 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b666210d-32ca-44d0-a28c-6ad5c4ad1546 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2069449035" status: 202 len: 0 microversion: 2.1 time: 0.105498 Jul 28 18:20:25.677437 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 375/751] 10.222.0.86 () {58 vars in 1221 bytes} [Thu Jul 28 18:20:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2069449035 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 18:20:26.611908 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-81d51b34-6ecd-4ffd-af94-9469cdbf59c7 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:20:26.612649 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-81d51b34-6ecd-4ffd-af94-9469cdbf59c7 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:20:26.619289 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-81d51b34-6ecd-4ffd-af94-9469cdbf59c7 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:26.619767 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-81d51b34-6ecd-4ffd-af94-9469cdbf59c7 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:26.620631 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-81d51b34-6ecd-4ffd-af94-9469cdbf59c7 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:26.621113 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-81d51b34-6ecd-4ffd-af94-9469cdbf59c7 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:26.655742 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-81d51b34-6ecd-4ffd-af94-9469cdbf59c7 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:26.656313 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-81d51b34-6ecd-4ffd-af94-9469cdbf59c7 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:26.656836 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.objects.instance [None req-81d51b34-6ecd-4ffd-af94-9469cdbf59c7 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lazy-loading 'fault' on Instance uuid 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd {{(pid=118454) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:20:26.715616 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-81d51b34-6ecd-4ffd-af94-9469cdbf59c7 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:26.723245 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-81d51b34-6ecd-4ffd-af94-9469cdbf59c7 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 200 len: 1327 microversion: 2.1 time: 0.115085 Jul 28 18:20:26.723658 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 377/752] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:20:26 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 1327 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:20:27.750058 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d705ce80-d19a-4462-ae70-28067604ca18 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:20:27.750778 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-d705ce80-d19a-4462-ae70-28067604ca18 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:20:27.756924 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d705ce80-d19a-4462-ae70-28067604ca18 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:27.757412 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d705ce80-d19a-4462-ae70-28067604ca18 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:27.758162 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d705ce80-d19a-4462-ae70-28067604ca18 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:27.758595 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d705ce80-d19a-4462-ae70-28067604ca18 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:27.772218 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.wsgi [None req-d705ce80-d19a-4462-ae70-28067604ca18 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] HTTP exception thrown: Instance 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd could not be found. Jul 28 18:20:27.773828 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d705ce80-d19a-4462-ae70-28067604ca18 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Request method failure captured: Jul 28 18:20:27.773828 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: request: GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd HTTP/1.1 Jul 28 18:20:27.773828 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Accept: application/json Jul 28 18:20:27.773828 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Accept-Encoding: identity Jul 28 18:20:27.773828 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Connection: close Jul 28 18:20:27.773828 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Content-Length: 0 Jul 28 18:20:27.773828 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Content-Type: application/json Jul 28 18:20:27.773828 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Host: 10.222.0.86 Jul 28 18:20:27.773828 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Openstack-System-Scope: None Jul 28 18:20:27.773828 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: User-Agent: python-urllib3/1.26.10 Jul 28 18:20:27.773828 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Auth-Token: gAAAAABi4tGZwQqhDXNpTfepZnH03id89znztxzbAkUoDYCpmR89uQmPd_pwxY8T0tqiEQgonQdZupDmunanwgaXh53F1U2jPZuOy0ejShuSnTpD6FdOLZAlpwOktLJ8cvE9Pr7OjzPe3O4_PKKJ2Xns136QGP8xbtp1GjM9MiCA62BwFaEpJbo Jul 28 18:20:27.773828 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Domain-Id: None Jul 28 18:20:27.773828 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Domain-Name: None Jul 28 18:20:27.773828 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Identity-Status: Confirmed Jul 28 18:20:27.773828 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Is-Admin-Project: True Jul 28 18:20:27.773828 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Id: default Jul 28 18:20:27.773828 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Name: Default Jul 28 18:20:27.773828 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Id: 27b91f25d2be408ba9e8d667a574a7a9 Jul 28 18:20:27.773828 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Name: tempest-AttachVolumeTestJSON-1940292949 Jul 28 18:20:27.773828 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Role: member,reader Jul 28 18:20:27.773828 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Roles: member,reader Jul 28 18:20:27.775391 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_27b91f25d2be408ba9e8d667a574a7a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/27b91f25d2be408ba9e8d667a574a7a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/27b91f25d2be408ba9e8d667a574a7a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/27b91f25d2be408ba9e8d667a574a7a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}] Jul 28 18:20:27.775391 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant: tempest-AttachVolumeTestJSON-1940292949 Jul 28 18:20:27.775391 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant-Id: 27b91f25d2be408ba9e8d667a574a7a9 Jul 28 18:20:27.775391 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1940292949 Jul 28 18:20:27.775391 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User: tempest-AttachVolumeTestJSON-1940292949-project Jul 28 18:20:27.775391 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Id: default Jul 28 18:20:27.775391 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Name: Default Jul 28 18:20:27.775391 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Id: b9874df18af245688db1137b6f1b0bff Jul 28 18:20:27.775391 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Name: tempest-AttachVolumeTestJSON-1940292949-project Jul 28 18:20:27.775391 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: method: > Jul 28 18:20:27.775391 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: exception: Instance 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd could not be found. Jul 28 18:20:27.775391 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: action_args: {'id': '3f8c8622-dfde-4eb5-95c4-7716aebf0fcd'} Jul 28 18:20:27.776414 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:20:27.776414 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:20:27.776414 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:20:27.776414 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:20:27.776414 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:20:27.776414 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:20:27.776414 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:20:27.776414 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:20:27.776414 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:20:27.776414 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:20:27.776414 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd could not be found. Jul 28 18:20:27.776414 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:20:27.776414 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:20:27.776414 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:20:27.776414 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:20:27.776414 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:20:27.776414 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:20:27.776414 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:20:27.776414 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:20:27.776414 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:20:27.777921 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:20:27.777921 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 18:20:27.777921 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 18:20:27.777921 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:20:27.777921 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:20:27.777921 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:20:27.777921 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:20:27.777921 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd could not be found. Jul 28 18:20:27.777921 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:20:27.777921 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:20:27.777921 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:20:27.777921 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:20:27.777921 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:20:27.777921 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:20:27.777921 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:20:27.777921 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:20:27.777921 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd could not be found. Jul 28 18:20:27.777921 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:20:27.779335 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d705ce80-d19a-4462-ae70-28067604ca18 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Returning 404 to user: Instance 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd could not be found. {{(pid=118453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:20:27.779335 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-d705ce80-d19a-4462-ae70-28067604ca18 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 404 len: 111 microversion: 2.1 time: 0.030273 Jul 28 18:20:27.779335 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 376/753] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:20:27 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:20:27.784547 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-ce93d250-db57-49eb-9d05-1db15087bcdd tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '.version_select at 0x7f6fe23674c0>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:20:27.859343 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-ce93d250-db57-49eb-9d05-1db15087bcdd tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-343976042" status: 202 len: 0 microversion: 2.1 time: 0.078543 Jul 28 18:20:27.859925 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 378/754] 10.222.0.86 () {58 vars in 1218 bytes} [Thu Jul 28 18:20:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-343976042 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 18:20:28.875604 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-203feb58-cf6f-4055-90c2-3412dfb0a64a tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Action: 'create', calling method: .version_select at 0x7f6fe2541c10>, body: {"keypair": {"name": "tempest-keypair-1212531576", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD02Bg93zJujxxS/mxzKsRQOa/I1tBLQXz8iVUqLeQb/qu7oxYftCZ9pjOkAyb46WE5NG8x98xWyDI6y8e/foVEFBqM+8srgVDdyDX1CPY+Ax7YF/Gy/jgZjrEQ+bV+3pg=="}} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:20:28.891779 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.quota [None req-203feb58-cf6f-4055-90c2-3412dfb0a64a tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Getting quotas for project 27b91f25d2be408ba9e8d667a574a7a9. Resources: {'key_pairs'} {{(pid=118453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 18:20:28.895646 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.quota [None req-203feb58-cf6f-4055-90c2-3412dfb0a64a tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Getting quotas for user b9874df18af245688db1137b6f1b0bff and project 27b91f25d2be408ba9e8d667a574a7a9. Resources: {'key_pairs'} {{(pid=118453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 18:20:28.978803 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-203feb58-cf6f-4055-90c2-3412dfb0a64a tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.107057 Jul 28 18:20:28.979398 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 377/755] 10.222.0.86 () {60 vars in 1159 bytes} [Thu Jul 28 18:20:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:20:29.275142 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-fe963c27-7c57-4d3e-82aa-d5e79d3e286b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:20:29.275668 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-fe963c27-7c57-4d3e-82aa-d5e79d3e286b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:20:29.282362 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-fe963c27-7c57-4d3e-82aa-d5e79d3e286b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:29.282810 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-fe963c27-7c57-4d3e-82aa-d5e79d3e286b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:29.283561 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-fe963c27-7c57-4d3e-82aa-d5e79d3e286b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:29.283993 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-fe963c27-7c57-4d3e-82aa-d5e79d3e286b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:29.288340 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell1:SELECT=100 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:20:29.309342 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-fe963c27-7c57-4d3e-82aa-d5e79d3e286b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Going to try to terminate instance {{(pid=118454) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 18:20:29.600672 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-fe963c27-7c57-4d3e-82aa-d5e79d3e286b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "DELETE /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 204 len: 0 microversion: 2.1 time: 0.329355 Jul 28 18:20:29.601265 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 379/756] 10.222.0.86 () {58 vars in 1239 bytes} [Thu Jul 28 18:20:29 2022] DELETE /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 18:20:29.609726 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-866cd471-0e3f-4a32-93bf-731d30646eed tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:20:29.610349 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-866cd471-0e3f-4a32-93bf-731d30646eed tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:20:29.618274 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-866cd471-0e3f-4a32-93bf-731d30646eed tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:29.623324 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-866cd471-0e3f-4a32-93bf-731d30646eed tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:29.623324 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-866cd471-0e3f-4a32-93bf-731d30646eed tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:29.623324 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-866cd471-0e3f-4a32-93bf-731d30646eed tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:29.753165 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-866cd471-0e3f-4a32-93bf-731d30646eed tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:29.760712 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-866cd471-0e3f-4a32-93bf-731d30646eed tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1509 microversion: 2.1 time: 0.155478 Jul 28 18:20:29.761304 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 378/757] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:20:29 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:20:30.781562 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-794b20b0-493c-4e7c-9778-a27523f2fd0d tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:20:30.782254 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-794b20b0-493c-4e7c-9778-a27523f2fd0d tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:20:30.790506 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-794b20b0-493c-4e7c-9778-a27523f2fd0d tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:30.790965 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-794b20b0-493c-4e7c-9778-a27523f2fd0d tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:30.791745 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-794b20b0-493c-4e7c-9778-a27523f2fd0d tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:30.792234 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-794b20b0-493c-4e7c-9778-a27523f2fd0d tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:30.931273 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-794b20b0-493c-4e7c-9778-a27523f2fd0d tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:30.942133 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-794b20b0-493c-4e7c-9778-a27523f2fd0d tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1509 microversion: 2.1 time: 0.164916 Jul 28 18:20:30.942716 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 380/758] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:20:30 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1509 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:20:31.363923 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-c2ced07f-9a80-4164-ae1a-dd4f6b5c912e req-b0c9c466-aec7-4754-ab85-48cf1714998a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75328faf-ff9c-4e13-9643-bb73b0079a5a", "name": "network-vif-deleted", "tag": "ae8cbb70-b373-4a44-b403-9f6ac40dbbca"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:20:31.379992 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-c2ced07f-9a80-4164-ae1a-dd4f6b5c912e req-b0c9c466-aec7-4754-ab85-48cf1714998a service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:31.380675 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-c2ced07f-9a80-4164-ae1a-dd4f6b5c912e req-b0c9c466-aec7-4754-ab85-48cf1714998a service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:31.392681 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-c2ced07f-9a80-4164-ae1a-dd4f6b5c912e req-b0c9c466-aec7-4754-ab85-48cf1714998a service nova] Creating event network-vif-deleted:ae8cbb70-b373-4a44-b403-9f6ac40dbbca for instance 75328faf-ff9c-4e13-9643-bb73b0079a5a on hv-cinder-84617 Jul 28 18:20:31.399925 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-c2ced07f-9a80-4164-ae1a-dd4f6b5c912e req-b0c9c466-aec7-4754-ab85-48cf1714998a service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039783 Jul 28 18:20:31.400538 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 379/759] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:20:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:20:31.501584 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-9d814c5e-4c1a-4bd9-baed-2ef308a6ee33 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1166367643", "imageRef": "61912422-61cd-4ced-a573-85ee305e010f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bff04af5-7af0-4830-a1e0-3c54d0cbddac"}], "security_groups": [{"name": "tempest-securitygroup--1279683149"}], "key_name": "tempest-keypair-1212531576", "user_data": "}} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:20:31.611675 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.network.neutron [None req-9d814c5e-4c1a-4bd9-baed-2ef308a6ee33 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] validate_networks() for [('bff04af5-7af0-4830-a1e0-3c54d0cbddac', None, None, None, None, None)] {{(pid=118454) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 18:20:31.962868 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-fb013e4b-ed10-4a52-a678-bc34d15e8a4b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:20:31.963636 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-fb013e4b-ed10-4a52-a678-bc34d15e8a4b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:20:31.970671 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fb013e4b-ed10-4a52-a678-bc34d15e8a4b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:31.971128 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fb013e4b-ed10-4a52-a678-bc34d15e8a4b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:31.971913 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fb013e4b-ed10-4a52-a678-bc34d15e8a4b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:31.972358 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fb013e4b-ed10-4a52-a678-bc34d15e8a4b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:31.977256 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:20:32.005351 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fb013e4b-ed10-4a52-a678-bc34d15e8a4b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:32.005947 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fb013e4b-ed10-4a52-a678-bc34d15e8a4b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:32.006410 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.objects.instance [None req-fb013e4b-ed10-4a52-a678-bc34d15e8a4b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lazy-loading 'fault' on Instance uuid 75328faf-ff9c-4e13-9643-bb73b0079a5a {{(pid=118453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:20:32.014856 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.virt.hardware [None req-9d814c5e-4c1a-4bd9-baed-2ef308a6ee33 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Flavor limits 0:0:0 {{(pid=118454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 18:20:32.015926 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.virt.hardware [None req-9d814c5e-4c1a-4bd9-baed-2ef308a6ee33 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Image limits 0:0:0 {{(pid=118454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 18:20:32.016643 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.virt.hardware [None req-9d814c5e-4c1a-4bd9-baed-2ef308a6ee33 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Flavor pref 0:0:0 {{(pid=118454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 18:20:32.017374 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.virt.hardware [None req-9d814c5e-4c1a-4bd9-baed-2ef308a6ee33 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Image pref 0:0:0 {{(pid=118454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 18:20:32.017860 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.virt.hardware [None req-9d814c5e-4c1a-4bd9-baed-2ef308a6ee33 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 18:20:32.027122 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-9d814c5e-4c1a-4bd9-baed-2ef308a6ee33 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:32.027838 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-9d814c5e-4c1a-4bd9-baed-2ef308a6ee33 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:32.028865 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-9d814c5e-4c1a-4bd9-baed-2ef308a6ee33 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:32.029366 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-9d814c5e-4c1a-4bd9-baed-2ef308a6ee33 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:32.049753 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.quota [None req-9d814c5e-4c1a-4bd9-baed-2ef308a6ee33 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Getting quotas for project 27b91f25d2be408ba9e8d667a574a7a9. Resources: {'cores', 'ram', 'instances'} {{(pid=118454) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 18:20:32.050608 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-fb013e4b-ed10-4a52-a678-bc34d15e8a4b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:32.053809 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.quota [None req-9d814c5e-4c1a-4bd9-baed-2ef308a6ee33 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Getting quotas for user b9874df18af245688db1137b6f1b0bff and project 27b91f25d2be408ba9e8d667a574a7a9. Resources: {'cores', 'ram', 'instances'} {{(pid=118454) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 18:20:32.058398 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-fb013e4b-ed10-4a52-a678-bc34d15e8a4b tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 200 len: 1312 microversion: 2.1 time: 0.099832 Jul 28 18:20:32.058972 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 380/760] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:20:31 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 1312 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:20:32.066112 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-9d814c5e-4c1a-4bd9-baed-2ef308a6ee33 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Going to run 1 instances... {{(pid=118454) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 18:20:32.070607 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-9d814c5e-4c1a-4bd9-baed-2ef308a6ee33 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: d729ee22-6dee-45a8-8460-14230cc47c0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='61912422-61cd-4ced-a573-85ee305e010f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118454) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 18:20:32.234339 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9d814c5e-4c1a-4bd9-baed-2ef308a6ee33 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [962d8db1-22de-41dd-aa25-7a1947bea151] AMQP server on 10.222.0.86:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 28 18:20:33.080113 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d097104b-29df-4502-a08d-4b62057f449a tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:20:33.080742 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-d097104b-29df-4502-a08d-4b62057f449a tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 75328faf-ff9c-4e13-9643-bb73b0079a5a] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:20:33.087927 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d097104b-29df-4502-a08d-4b62057f449a tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:33.088383 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d097104b-29df-4502-a08d-4b62057f449a tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:33.089185 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d097104b-29df-4502-a08d-4b62057f449a tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:33.089879 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d097104b-29df-4502-a08d-4b62057f449a tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:33.103774 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.wsgi [None req-d097104b-29df-4502-a08d-4b62057f449a tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] HTTP exception thrown: Instance 75328faf-ff9c-4e13-9643-bb73b0079a5a could not be found. Jul 28 18:20:33.105426 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d097104b-29df-4502-a08d-4b62057f449a tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Request method failure captured: Jul 28 18:20:33.105426 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: request: GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a HTTP/1.1 Jul 28 18:20:33.105426 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Accept: application/json Jul 28 18:20:33.105426 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Accept-Encoding: identity Jul 28 18:20:33.105426 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Connection: close Jul 28 18:20:33.105426 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Content-Length: 0 Jul 28 18:20:33.105426 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Content-Type: application/json Jul 28 18:20:33.105426 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Host: 10.222.0.86 Jul 28 18:20:33.105426 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Openstack-System-Scope: None Jul 28 18:20:33.105426 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: User-Agent: python-urllib3/1.26.10 Jul 28 18:20:33.105426 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Auth-Token: gAAAAABi4tGak9iMP6i4DT42V1NnqmCZswp-XsfRnXwgZ5TInbJk7FNT9dOnhbjnqjtBLXPdrsj1TUIXXmpk6dZ3xWlxYxbYapUjkHD0Drg44UTheFQ5ZV9AjLn6l50Z1n5iufsCuAsTGkiWhMhNQDT75zNabsY87wD-531cxucsWWBAMcMaNMQ Jul 28 18:20:33.105426 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Domain-Id: None Jul 28 18:20:33.105426 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Domain-Name: None Jul 28 18:20:33.105426 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Identity-Status: Confirmed Jul 28 18:20:33.105426 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Is-Admin-Project: True Jul 28 18:20:33.105426 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Id: default Jul 28 18:20:33.105426 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Name: Default Jul 28 18:20:33.105426 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Id: b52f26ab8b934756b0c74d681d08d04f Jul 28 18:20:33.105426 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1347813421 Jul 28 18:20:33.105426 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Role: member,reader Jul 28 18:20:33.105426 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Roles: member,reader Jul 28 18:20:33.107010 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_b52f26ab8b934756b0c74d681d08d04f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/b52f26ab8b934756b0c74d681d08d04f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/b52f26ab8b934756b0c74d681d08d04f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/b52f26ab8b934756b0c74d681d08d04f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}] Jul 28 18:20:33.107010 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1347813421 Jul 28 18:20:33.107010 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant-Id: b52f26ab8b934756b0c74d681d08d04f Jul 28 18:20:33.107010 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1347813421 Jul 28 18:20:33.107010 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User: tempest-ServerRescueNegativeTestJSON-1347813421-project Jul 28 18:20:33.107010 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Id: default Jul 28 18:20:33.107010 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Name: Default Jul 28 18:20:33.107010 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Id: 5ef698c4f57f44d387550921a288d7ab Jul 28 18:20:33.107010 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1347813421-project Jul 28 18:20:33.107010 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: method: > Jul 28 18:20:33.107010 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: exception: Instance 75328faf-ff9c-4e13-9643-bb73b0079a5a could not be found. Jul 28 18:20:33.107010 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: action_args: {'id': '75328faf-ff9c-4e13-9643-bb73b0079a5a'} Jul 28 18:20:33.107784 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:20:33.107784 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:20:33.107784 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:20:33.107784 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:20:33.107784 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:20:33.107784 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:20:33.107784 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:20:33.107784 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:20:33.107784 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:20:33.107784 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:20:33.107784 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75328faf-ff9c-4e13-9643-bb73b0079a5a could not be found. Jul 28 18:20:33.107784 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:20:33.107784 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:20:33.107784 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:20:33.107784 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:20:33.107784 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:20:33.107784 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:20:33.107784 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:20:33.107784 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:20:33.107784 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:20:33.109073 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:20:33.109073 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 18:20:33.109073 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 18:20:33.109073 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:20:33.109073 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:20:33.109073 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:20:33.109073 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:20:33.109073 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75328faf-ff9c-4e13-9643-bb73b0079a5a could not be found. Jul 28 18:20:33.109073 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:20:33.109073 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:20:33.109073 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:20:33.109073 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:20:33.109073 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:20:33.109073 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:20:33.109073 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:20:33.109073 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:20:33.109073 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75328faf-ff9c-4e13-9643-bb73b0079a5a could not be found. Jul 28 18:20:33.109073 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:20:33.110210 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d097104b-29df-4502-a08d-4b62057f449a tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Returning 404 to user: Instance 75328faf-ff9c-4e13-9643-bb73b0079a5a could not be found. {{(pid=118453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:20:33.110210 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-d097104b-29df-4502-a08d-4b62057f449a tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a" status: 404 len: 111 microversion: 2.1 time: 0.031168 Jul 28 18:20:33.110210 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 381/761] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:20:33 2022] GET /compute/v2.1/servers/75328faf-ff9c-4e13-9643-bb73b0079a5a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 18:20:33.115181 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-cc04b8d8-7466-40f2-8e36-c16a711b3b2e tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:20:33.115711 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-cc04b8d8-7466-40f2-8e36-c16a711b3b2e tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:20:33.122628 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cc04b8d8-7466-40f2-8e36-c16a711b3b2e tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:33.123078 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cc04b8d8-7466-40f2-8e36-c16a711b3b2e tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:33.123847 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cc04b8d8-7466-40f2-8e36-c16a711b3b2e tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:33.124331 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cc04b8d8-7466-40f2-8e36-c16a711b3b2e tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:33.149995 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-cc04b8d8-7466-40f2-8e36-c16a711b3b2e tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1] Going to try to terminate instance {{(pid=118453) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 18:20:33.241376 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO oslo.messaging._drivers.impl_rabbit [None req-9d814c5e-4c1a-4bd9-baed-2ef308a6ee33 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [962d8db1-22de-41dd-aa25-7a1947bea151] Reconnected to AMQP server on 10.222.0.86:5672 via [amqp] client with port 52462. Jul 28 18:20:33.254948 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-9d814c5e-4c1a-4bd9-baed-2ef308a6ee33 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.757993 Jul 28 18:20:33.255816 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 381/762] 10.222.0.86 () {60 vars in 1147 bytes} [Thu Jul 28 18:20:31 2022] POST /compute/v2.1/servers => generated 402 bytes in 1759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 18:20:33.267575 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-4b203341-f023-4936-8c1f-cf4eabca540e tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:20:33.268205 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-4b203341-f023-4936-8c1f-cf4eabca540e tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: d729ee22-6dee-45a8-8460-14230cc47c0e] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:20:33.321790 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-4b203341-f023-4936-8c1f-cf4eabca540e tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:33.330514 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-4b203341-f023-4936-8c1f-cf4eabca540e tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e" status: 200 len: 1238 microversion: 2.1 time: 0.067469 Jul 28 18:20:33.344013 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 382/763] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:20:33 2022] GET /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e => generated 1238 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:20:33.429506 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-cc04b8d8-7466-40f2-8e36-c16a711b3b2e tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "DELETE /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1" status: 204 len: 0 microversion: 2.1 time: 0.317718 Jul 28 18:20:33.430098 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 382/764] 10.222.0.86 () {58 vars in 1239 bytes} [Thu Jul 28 18:20:33 2022] DELETE /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 18:20:33.438767 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-672464a2-de9c-45f5-9e1a-e1003fe6d31f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:20:33.439442 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-672464a2-de9c-45f5-9e1a-e1003fe6d31f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:20:33.445687 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-672464a2-de9c-45f5-9e1a-e1003fe6d31f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:33.446396 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-672464a2-de9c-45f5-9e1a-e1003fe6d31f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:33.447195 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-672464a2-de9c-45f5-9e1a-e1003fe6d31f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:33.447645 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-672464a2-de9c-45f5-9e1a-e1003fe6d31f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:33.581405 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-672464a2-de9c-45f5-9e1a-e1003fe6d31f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:33.588793 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-672464a2-de9c-45f5-9e1a-e1003fe6d31f tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1" status: 200 len: 1522 microversion: 2.1 time: 0.154453 Jul 28 18:20:33.589637 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 383/765] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:20:33 2022] GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:20:34.352276 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5e842971-8468-4ae9-83d7-3b9b4a6723e5 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:20:34.352987 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-5e842971-8468-4ae9-83d7-3b9b4a6723e5 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: d729ee22-6dee-45a8-8460-14230cc47c0e] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:20:34.406234 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-5e842971-8468-4ae9-83d7-3b9b4a6723e5 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:34.412996 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-5e842971-8468-4ae9-83d7-3b9b4a6723e5 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e" status: 200 len: 1238 microversion: 2.1 time: 0.064989 Jul 28 18:20:34.413556 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 383/766] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:20:34 2022] GET /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e => generated 1238 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:20:34.609088 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-f040e3d5-9865-4cc2-84a6-117641caa60c tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:20:34.610062 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-f040e3d5-9865-4cc2-84a6-117641caa60c tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:20:34.616601 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f040e3d5-9865-4cc2-84a6-117641caa60c tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:34.617088 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f040e3d5-9865-4cc2-84a6-117641caa60c tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:34.617866 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f040e3d5-9865-4cc2-84a6-117641caa60c tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:34.618305 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f040e3d5-9865-4cc2-84a6-117641caa60c tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:34.748440 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-f040e3d5-9865-4cc2-84a6-117641caa60c tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:34.756395 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-f040e3d5-9865-4cc2-84a6-117641caa60c tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1" status: 200 len: 1522 microversion: 2.1 time: 0.151120 Jul 28 18:20:34.757270 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 384/767] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:20:34 2022] GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:20:35.434060 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b277b44f-eb1c-4d24-8b3c-aa5c399132d1 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:20:35.434678 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b277b44f-eb1c-4d24-8b3c-aa5c399132d1 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: d729ee22-6dee-45a8-8460-14230cc47c0e] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:20:35.442204 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b277b44f-eb1c-4d24-8b3c-aa5c399132d1 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:35.442660 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b277b44f-eb1c-4d24-8b3c-aa5c399132d1 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:35.443431 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b277b44f-eb1c-4d24-8b3c-aa5c399132d1 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:35.443879 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b277b44f-eb1c-4d24-8b3c-aa5c399132d1 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:35.502995 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b277b44f-eb1c-4d24-8b3c-aa5c399132d1 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:35.510299 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b277b44f-eb1c-4d24-8b3c-aa5c399132d1 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e" status: 200 len: 1242 microversion: 2.1 time: 0.080153 Jul 28 18:20:35.510854 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 384/768] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:20:35 2022] GET /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e => generated 1242 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:20:35.778055 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-27dcd7a2-c55e-4a62-a63e-f28d3a65bc34 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:20:35.778662 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-27dcd7a2-c55e-4a62-a63e-f28d3a65bc34 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:20:35.785070 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-27dcd7a2-c55e-4a62-a63e-f28d3a65bc34 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:35.785547 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-27dcd7a2-c55e-4a62-a63e-f28d3a65bc34 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:35.786310 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-27dcd7a2-c55e-4a62-a63e-f28d3a65bc34 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:35.786828 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-27dcd7a2-c55e-4a62-a63e-f28d3a65bc34 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:35.920831 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-27dcd7a2-c55e-4a62-a63e-f28d3a65bc34 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:35.928378 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-27dcd7a2-c55e-4a62-a63e-f28d3a65bc34 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1" status: 200 len: 1522 microversion: 2.1 time: 0.154201 Jul 28 18:20:35.928981 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 385/769] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:20:35 2022] GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:20:36.156469 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-95ae0118-6323-4722-84d5-6a365e3b5ce0 req-45d35026-e695-4c47-918e-eef1f15a1e5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1", "name": "network-vif-deleted", "tag": "f42a05fc-306d-49b7-863f-7888a1c5f431"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:20:36.166184 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-95ae0118-6323-4722-84d5-6a365e3b5ce0 req-45d35026-e695-4c47-918e-eef1f15a1e5e service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:36.166627 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-95ae0118-6323-4722-84d5-6a365e3b5ce0 req-45d35026-e695-4c47-918e-eef1f15a1e5e service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:36.178398 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-95ae0118-6323-4722-84d5-6a365e3b5ce0 req-45d35026-e695-4c47-918e-eef1f15a1e5e service nova] Creating event network-vif-deleted:f42a05fc-306d-49b7-863f-7888a1c5f431 for instance 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 on hv-cinder-84617 Jul 28 18:20:36.183072 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-95ae0118-6323-4722-84d5-6a365e3b5ce0 req-45d35026-e695-4c47-918e-eef1f15a1e5e service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030575 Jul 28 18:20:36.183649 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 385/770] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:20:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:20:36.532607 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-1b9b37c4-30a3-4df3-9af1-dc95504992eb tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:20:36.533269 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-1b9b37c4-30a3-4df3-9af1-dc95504992eb tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: d729ee22-6dee-45a8-8460-14230cc47c0e] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:20:36.547203 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-1b9b37c4-30a3-4df3-9af1-dc95504992eb tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:36.547651 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-1b9b37c4-30a3-4df3-9af1-dc95504992eb tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:36.548426 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-1b9b37c4-30a3-4df3-9af1-dc95504992eb tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:36.548861 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-1b9b37c4-30a3-4df3-9af1-dc95504992eb tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:36.613641 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-1b9b37c4-30a3-4df3-9af1-dc95504992eb tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:36.621058 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-1b9b37c4-30a3-4df3-9af1-dc95504992eb tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e" status: 200 len: 1234 microversion: 2.1 time: 0.093964 Jul 28 18:20:36.621617 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 386/771] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:20:36 2022] GET /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e => generated 1234 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:20:36.951866 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-34048c09-8a14-410e-8f81-350457649574 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:20:36.952560 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-34048c09-8a14-410e-8f81-350457649574 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:20:36.959030 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-34048c09-8a14-410e-8f81-350457649574 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:36.959482 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-34048c09-8a14-410e-8f81-350457649574 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:36.960235 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-34048c09-8a14-410e-8f81-350457649574 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:36.960669 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-34048c09-8a14-410e-8f81-350457649574 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:36.991878 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-34048c09-8a14-410e-8f81-350457649574 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:36.992336 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-34048c09-8a14-410e-8f81-350457649574 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:36.992779 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.objects.instance [None req-34048c09-8a14-410e-8f81-350457649574 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lazy-loading 'fault' on Instance uuid 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 {{(pid=118453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:20:37.034004 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-34048c09-8a14-410e-8f81-350457649574 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef698c4f57f44d387550921a288d7ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52f26ab8b934756b0c74d681d08d04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:37.041480 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-34048c09-8a14-410e-8f81-350457649574 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1" status: 200 len: 1311 microversion: 2.1 time: 0.095331 Jul 28 18:20:37.043657 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 386/772] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:20:36 2022] GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 => generated 1311 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:20:37.646197 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-72069f86-b663-4bea-851a-c8d3ece2b73a tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:20:37.646845 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-72069f86-b663-4bea-851a-c8d3ece2b73a tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: d729ee22-6dee-45a8-8460-14230cc47c0e] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:20:37.653430 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-72069f86-b663-4bea-851a-c8d3ece2b73a tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:37.654376 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-72069f86-b663-4bea-851a-c8d3ece2b73a tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:37.655289 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-72069f86-b663-4bea-851a-c8d3ece2b73a tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:37.655585 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-72069f86-b663-4bea-851a-c8d3ece2b73a tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:37.733926 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-72069f86-b663-4bea-851a-c8d3ece2b73a tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:37.742340 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-72069f86-b663-4bea-851a-c8d3ece2b73a tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e" status: 200 len: 1290 microversion: 2.1 time: 0.100085 Jul 28 18:20:37.742921 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 387/773] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:20:37 2022] GET /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e => generated 1290 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:20:38.062538 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-74b643ee-b5e1-411f-a6ee-3ea17ec339b8 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:20:38.062922 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-74b643ee-b5e1-411f-a6ee-3ea17ec339b8 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] [instance: 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:20:38.069593 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-74b643ee-b5e1-411f-a6ee-3ea17ec339b8 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:38.070050 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-74b643ee-b5e1-411f-a6ee-3ea17ec339b8 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:38.070823 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-74b643ee-b5e1-411f-a6ee-3ea17ec339b8 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:38.071268 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-74b643ee-b5e1-411f-a6ee-3ea17ec339b8 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:38.084394 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.wsgi [None req-74b643ee-b5e1-411f-a6ee-3ea17ec339b8 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] HTTP exception thrown: Instance 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 could not be found. Jul 28 18:20:38.086070 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-74b643ee-b5e1-411f-a6ee-3ea17ec339b8 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Request method failure captured: Jul 28 18:20:38.086070 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: request: GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 HTTP/1.1 Jul 28 18:20:38.086070 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Accept: application/json Jul 28 18:20:38.086070 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Accept-Encoding: identity Jul 28 18:20:38.086070 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Connection: close Jul 28 18:20:38.086070 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Content-Length: 0 Jul 28 18:20:38.086070 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Content-Type: application/json Jul 28 18:20:38.086070 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Host: 10.222.0.86 Jul 28 18:20:38.086070 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Openstack-System-Scope: None Jul 28 18:20:38.086070 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: User-Agent: python-urllib3/1.26.10 Jul 28 18:20:38.086070 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Auth-Token: gAAAAABi4tGak9iMP6i4DT42V1NnqmCZswp-XsfRnXwgZ5TInbJk7FNT9dOnhbjnqjtBLXPdrsj1TUIXXmpk6dZ3xWlxYxbYapUjkHD0Drg44UTheFQ5ZV9AjLn6l50Z1n5iufsCuAsTGkiWhMhNQDT75zNabsY87wD-531cxucsWWBAMcMaNMQ Jul 28 18:20:38.086070 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Domain-Id: None Jul 28 18:20:38.086070 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Domain-Name: None Jul 28 18:20:38.086070 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Identity-Status: Confirmed Jul 28 18:20:38.086070 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Is-Admin-Project: True Jul 28 18:20:38.086070 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Id: default Jul 28 18:20:38.086070 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Name: Default Jul 28 18:20:38.086070 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Id: b52f26ab8b934756b0c74d681d08d04f Jul 28 18:20:38.086070 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1347813421 Jul 28 18:20:38.086070 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Role: member,reader Jul 28 18:20:38.086070 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Roles: member,reader Jul 28 18:20:38.087649 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_b52f26ab8b934756b0c74d681d08d04f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/b52f26ab8b934756b0c74d681d08d04f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/b52f26ab8b934756b0c74d681d08d04f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/b52f26ab8b934756b0c74d681d08d04f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}] Jul 28 18:20:38.087649 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1347813421 Jul 28 18:20:38.087649 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant-Id: b52f26ab8b934756b0c74d681d08d04f Jul 28 18:20:38.087649 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1347813421 Jul 28 18:20:38.087649 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User: tempest-ServerRescueNegativeTestJSON-1347813421-project Jul 28 18:20:38.087649 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Id: default Jul 28 18:20:38.087649 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Name: Default Jul 28 18:20:38.087649 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Id: 5ef698c4f57f44d387550921a288d7ab Jul 28 18:20:38.087649 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1347813421-project Jul 28 18:20:38.087649 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: method: > Jul 28 18:20:38.087649 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: exception: Instance 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 could not be found. Jul 28 18:20:38.087649 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: action_args: {'id': '7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1'} Jul 28 18:20:38.088503 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:20:38.088503 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:20:38.088503 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:20:38.088503 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:20:38.088503 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:20:38.088503 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:20:38.088503 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:20:38.088503 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:20:38.088503 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:20:38.088503 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:20:38.088503 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 could not be found. Jul 28 18:20:38.088503 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:20:38.088503 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:20:38.088503 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:20:38.088503 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:20:38.088503 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:20:38.088503 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:20:38.088503 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:20:38.088503 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:20:38.088503 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:20:38.090291 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:20:38.090291 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 18:20:38.090291 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 18:20:38.090291 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:20:38.090291 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:20:38.090291 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:20:38.090291 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:20:38.090291 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 could not be found. Jul 28 18:20:38.090291 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:20:38.090291 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:20:38.090291 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:20:38.090291 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:20:38.090291 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:20:38.090291 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:20:38.090291 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:20:38.090291 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:20:38.090291 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 could not be found. Jul 28 18:20:38.090291 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:20:38.092183 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-74b643ee-b5e1-411f-a6ee-3ea17ec339b8 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] Returning 404 to user: Instance 7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 could not be found. {{(pid=118453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:20:38.092183 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-74b643ee-b5e1-411f-a6ee-3ea17ec339b8 tempest-ServerRescueNegativeTestJSON-1347813421 tempest-ServerRescueNegativeTestJSON-1347813421-project] 10.222.0.86 "GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1" status: 404 len: 111 microversion: 2.1 time: 0.029449 Jul 28 18:20:38.092183 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 387/774] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:20:38 2022] GET /compute/v2.1/servers/7d7819db-2ad6-48b6-8ca7-b2d5a23be5b1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:20:38.768187 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-210e7c54-468d-4fb5-95bb-09d8a71b0cc6 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:20:38.769114 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-210e7c54-468d-4fb5-95bb-09d8a71b0cc6 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: d729ee22-6dee-45a8-8460-14230cc47c0e] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:20:38.779227 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-210e7c54-468d-4fb5-95bb-09d8a71b0cc6 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:38.779647 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-210e7c54-468d-4fb5-95bb-09d8a71b0cc6 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:38.780448 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-210e7c54-468d-4fb5-95bb-09d8a71b0cc6 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:38.780910 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-210e7c54-468d-4fb5-95bb-09d8a71b0cc6 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:38.986289 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-210e7c54-468d-4fb5-95bb-09d8a71b0cc6 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:38.994627 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-210e7c54-468d-4fb5-95bb-09d8a71b0cc6 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e" status: 200 len: 1364 microversion: 2.1 time: 0.234464 Jul 28 18:20:38.995206 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 388/775] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:20:38 2022] GET /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e => generated 1364 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:20:39.484216 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-7a54b714-ecfa-46ed-bee9-a0495bcaf1b0 req-8f2ed863-4336-41c2-8168-d15bb3500ee3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d729ee22-6dee-45a8-8460-14230cc47c0e", "tag": "ed94d36a-868e-4de5-a346-139f9947c086"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:20:39.506677 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-7a54b714-ecfa-46ed-bee9-a0495bcaf1b0 req-8f2ed863-4336-41c2-8168-d15bb3500ee3 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:39.507140 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-7a54b714-ecfa-46ed-bee9-a0495bcaf1b0 req-8f2ed863-4336-41c2-8168-d15bb3500ee3 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:39.524448 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-7a54b714-ecfa-46ed-bee9-a0495bcaf1b0 req-8f2ed863-4336-41c2-8168-d15bb3500ee3 service nova] Creating event network-changed:ed94d36a-868e-4de5-a346-139f9947c086 for instance d729ee22-6dee-45a8-8460-14230cc47c0e on hv-cinder-84617 Jul 28 18:20:39.534477 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-7a54b714-ecfa-46ed-bee9-a0495bcaf1b0 req-8f2ed863-4336-41c2-8168-d15bb3500ee3 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054025 Jul 28 18:20:39.534477 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 388/776] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:20:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:20:40.016719 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-50701d24-68ad-4ed8-8ca4-b29ab60a101b tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:20:40.017915 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-50701d24-68ad-4ed8-8ca4-b29ab60a101b tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: d729ee22-6dee-45a8-8460-14230cc47c0e] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:20:40.029866 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-50701d24-68ad-4ed8-8ca4-b29ab60a101b tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:40.031028 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-50701d24-68ad-4ed8-8ca4-b29ab60a101b tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:40.032137 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-50701d24-68ad-4ed8-8ca4-b29ab60a101b tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:40.033043 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-50701d24-68ad-4ed8-8ca4-b29ab60a101b tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:40.479082 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-50701d24-68ad-4ed8-8ca4-b29ab60a101b tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:40.489671 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-50701d24-68ad-4ed8-8ca4-b29ab60a101b tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e" status: 200 len: 1364 microversion: 2.1 time: 0.477626 Jul 28 18:20:40.490292 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 389/777] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:20:40 2022] GET /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e => generated 1364 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:20:41.512014 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-c77ccee6-a5d8-4fd2-a0e1-4eaa426074f2 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:20:41.512712 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-c77ccee6-a5d8-4fd2-a0e1-4eaa426074f2 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: d729ee22-6dee-45a8-8460-14230cc47c0e] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:20:41.519059 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c77ccee6-a5d8-4fd2-a0e1-4eaa426074f2 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:41.519510 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c77ccee6-a5d8-4fd2-a0e1-4eaa426074f2 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:41.520278 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c77ccee6-a5d8-4fd2-a0e1-4eaa426074f2 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:41.520723 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c77ccee6-a5d8-4fd2-a0e1-4eaa426074f2 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:41.697826 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-c77ccee6-a5d8-4fd2-a0e1-4eaa426074f2 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:41.706780 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-c77ccee6-a5d8-4fd2-a0e1-4eaa426074f2 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e" status: 200 len: 1364 microversion: 2.1 time: 0.199167 Jul 28 18:20:41.726241 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 389/778] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:20:41 2022] GET /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e => generated 1364 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:20:42.729411 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-03fb7949-3183-4726-b8ab-ecc98d17278f tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:20:42.730026 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-03fb7949-3183-4726-b8ab-ecc98d17278f tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: d729ee22-6dee-45a8-8460-14230cc47c0e] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:20:42.732553 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell0:SELECT=2 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:20:42.737434 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-03fb7949-3183-4726-b8ab-ecc98d17278f tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:42.737881 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-03fb7949-3183-4726-b8ab-ecc98d17278f tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:42.751292 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-03fb7949-3183-4726-b8ab-ecc98d17278f tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:42.751292 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-03fb7949-3183-4726-b8ab-ecc98d17278f tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:42.905721 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-03fb7949-3183-4726-b8ab-ecc98d17278f tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:42.913237 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-03fb7949-3183-4726-b8ab-ecc98d17278f tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e" status: 200 len: 1364 microversion: 2.1 time: 0.187837 Jul 28 18:20:42.913808 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 390/779] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:20:42 2022] GET /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e => generated 1364 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:20:43.934103 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-4b62ae38-79b9-48f3-b581-60a592c35cb8 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:20:43.935394 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-4b62ae38-79b9-48f3-b581-60a592c35cb8 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: d729ee22-6dee-45a8-8460-14230cc47c0e] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:20:43.941876 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4b62ae38-79b9-48f3-b581-60a592c35cb8 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:43.942569 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4b62ae38-79b9-48f3-b581-60a592c35cb8 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:43.943354 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4b62ae38-79b9-48f3-b581-60a592c35cb8 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:43.943807 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4b62ae38-79b9-48f3-b581-60a592c35cb8 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:44.087718 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-4b62ae38-79b9-48f3-b581-60a592c35cb8 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:44.096325 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-4b62ae38-79b9-48f3-b581-60a592c35cb8 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e" status: 200 len: 1364 microversion: 2.1 time: 0.166311 Jul 28 18:20:44.096999 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 390/780] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:20:43 2022] GET /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:20:45.117802 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-cfc9d5dc-8434-4e2e-9f54-94cf829b8d1c tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:20:45.118410 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-cfc9d5dc-8434-4e2e-9f54-94cf829b8d1c tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: d729ee22-6dee-45a8-8460-14230cc47c0e] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:20:45.120284 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell0:SELECT=8 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:20:45.121444 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:20:45.126654 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-cfc9d5dc-8434-4e2e-9f54-94cf829b8d1c tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:45.127095 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-cfc9d5dc-8434-4e2e-9f54-94cf829b8d1c tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:45.127889 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-cfc9d5dc-8434-4e2e-9f54-94cf829b8d1c tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:45.128370 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-cfc9d5dc-8434-4e2e-9f54-94cf829b8d1c tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:45.269320 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-cfc9d5dc-8434-4e2e-9f54-94cf829b8d1c tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:45.277107 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-cfc9d5dc-8434-4e2e-9f54-94cf829b8d1c tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e" status: 200 len: 1364 microversion: 2.1 time: 0.163316 Jul 28 18:20:45.277707 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 391/781] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:20:45 2022] GET /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:20:46.116302 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-227ff3e3-bc53-45ec-addf-4af101d33384 req-1554fe4f-e677-48a8-a981-30dd862018f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d729ee22-6dee-45a8-8460-14230cc47c0e", "name": "network-vif-plugged", "status": "completed", "tag": "ed94d36a-868e-4de5-a346-139f9947c086"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:20:46.123223 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell0:SELECT=6 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:20:46.124621 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:20:46.129206 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-227ff3e3-bc53-45ec-addf-4af101d33384 req-1554fe4f-e677-48a8-a981-30dd862018f8 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:46.129661 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-227ff3e3-bc53-45ec-addf-4af101d33384 req-1554fe4f-e677-48a8-a981-30dd862018f8 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:46.144931 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-227ff3e3-bc53-45ec-addf-4af101d33384 req-1554fe4f-e677-48a8-a981-30dd862018f8 service nova] Creating event network-vif-plugged:ed94d36a-868e-4de5-a346-139f9947c086 for instance d729ee22-6dee-45a8-8460-14230cc47c0e on hv-cinder-84617 Jul 28 18:20:46.152475 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-227ff3e3-bc53-45ec-addf-4af101d33384 req-1554fe4f-e677-48a8-a981-30dd862018f8 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039433 Jul 28 18:20:46.153176 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 391/782] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:20:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 18:20:46.298849 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-dc41c022-0de0-42da-ba00-8d889dd0e3c8 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:20:46.300959 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-dc41c022-0de0-42da-ba00-8d889dd0e3c8 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: d729ee22-6dee-45a8-8460-14230cc47c0e] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:20:46.306432 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-dc41c022-0de0-42da-ba00-8d889dd0e3c8 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:46.306754 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-dc41c022-0de0-42da-ba00-8d889dd0e3c8 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:46.307544 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-dc41c022-0de0-42da-ba00-8d889dd0e3c8 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:46.307989 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-dc41c022-0de0-42da-ba00-8d889dd0e3c8 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:46.620182 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-dc41c022-0de0-42da-ba00-8d889dd0e3c8 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:46.630237 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-dc41c022-0de0-42da-ba00-8d889dd0e3c8 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e" status: 200 len: 1364 microversion: 2.1 time: 0.336010 Jul 28 18:20:46.631069 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 392/783] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:20:46 2022] GET /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e => generated 1364 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:20:47.655737 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5e730ac8-53d4-4078-940f-b460884ba053 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:20:47.661245 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-5e730ac8-53d4-4078-940f-b460884ba053 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: d729ee22-6dee-45a8-8460-14230cc47c0e] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:20:47.663346 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5e730ac8-53d4-4078-940f-b460884ba053 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:47.663802 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5e730ac8-53d4-4078-940f-b460884ba053 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:47.664586 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5e730ac8-53d4-4078-940f-b460884ba053 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:47.665062 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5e730ac8-53d4-4078-940f-b460884ba053 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:47.980660 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-5e730ac8-53d4-4078-940f-b460884ba053 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:47.988925 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-5e730ac8-53d4-4078-940f-b460884ba053 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e" status: 200 len: 1364 microversion: 2.1 time: 0.340857 Jul 28 18:20:48.002342 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 392/784] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:20:47 2022] GET /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e => generated 1364 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:20:49.011772 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-f04c98af-742e-4ae0-ac86-b117e45118fa tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:20:49.012393 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-f04c98af-742e-4ae0-ac86-b117e45118fa tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: d729ee22-6dee-45a8-8460-14230cc47c0e] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:20:49.019637 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f04c98af-742e-4ae0-ac86-b117e45118fa tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:49.020093 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f04c98af-742e-4ae0-ac86-b117e45118fa tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:49.020928 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f04c98af-742e-4ae0-ac86-b117e45118fa tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:49.021623 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f04c98af-742e-4ae0-ac86-b117e45118fa tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:49.296037 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-f04c98af-742e-4ae0-ac86-b117e45118fa tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:49.308005 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-f04c98af-742e-4ae0-ac86-b117e45118fa tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e" status: 200 len: 1550 microversion: 2.1 time: 0.301725 Jul 28 18:20:49.308871 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 393/785] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:20:49 2022] GET /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e => generated 1550 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:20:49.333694 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-dc68d2c0-ed5d-4fad-8e7b-ecc4f6ece6f9 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:20:49.334189 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-dc68d2c0-ed5d-4fad-8e7b-ecc4f6ece6f9 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: d729ee22-6dee-45a8-8460-14230cc47c0e] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:20:49.341594 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dc68d2c0-ed5d-4fad-8e7b-ecc4f6ece6f9 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:49.342431 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dc68d2c0-ed5d-4fad-8e7b-ecc4f6ece6f9 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:49.343714 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dc68d2c0-ed5d-4fad-8e7b-ecc4f6ece6f9 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:49.344290 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dc68d2c0-ed5d-4fad-8e7b-ecc4f6ece6f9 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:49.507664 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-dc68d2c0-ed5d-4fad-8e7b-ecc4f6ece6f9 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.177218 Jul 28 18:20:49.508387 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 393/786] 10.222.0.86 () {58 vars in 1275 bytes} [Thu Jul 28 18:20:49 2022] GET /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e/os-interface => generated 284 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:20:49.983686 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-f5244bec-89f1-4874-9e41-a57d595cf77d tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Action: 'create', calling method: .version_select at 0x7f6fe2425160>, body: {"keypair": {"name": "tempest-keypair-1954542310", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZaKaSi2QKUOokQZ7yt/dMw56LKNMIELWn/UD4mXmIHzBbYOku35rNfsx9AOSMqdFIbRzVSDNxJLd97RWo5WwfVPpJqIf6WA5xQOwhft8fu6dbvemg68c3EIOR22n6IsQ=="}} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:20:49.999707 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.quota [None req-f5244bec-89f1-4874-9e41-a57d595cf77d tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Getting quotas for project 104313ce72c94ea68c8cd3ee7f0cab2e. Resources: {'key_pairs'} {{(pid=118454) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 18:20:50.004262 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.quota [None req-f5244bec-89f1-4874-9e41-a57d595cf77d tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Getting quotas for user e2b1f1c4bb2747e0845cdc2991e53b09 and project 104313ce72c94ea68c8cd3ee7f0cab2e. Resources: {'key_pairs'} {{(pid=118454) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 18:20:50.081698 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-f5244bec-89f1-4874-9e41-a57d595cf77d tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.265337 Jul 28 18:20:50.082480 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 394/787] 10.222.0.86 () {60 vars in 1159 bytes} [Thu Jul 28 18:20:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:20:50.687097 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-64bd6c91-c793-4092-9cbb-12ced58d70f4 req-7dc83d35-9fad-4aea-a549-9649bfaa9e57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d729ee22-6dee-45a8-8460-14230cc47c0e", "tag": "ed94d36a-868e-4de5-a346-139f9947c086"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:20:50.696522 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-64bd6c91-c793-4092-9cbb-12ced58d70f4 req-7dc83d35-9fad-4aea-a549-9649bfaa9e57 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:50.696986 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-64bd6c91-c793-4092-9cbb-12ced58d70f4 req-7dc83d35-9fad-4aea-a549-9649bfaa9e57 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:50.708474 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-64bd6c91-c793-4092-9cbb-12ced58d70f4 req-7dc83d35-9fad-4aea-a549-9649bfaa9e57 service nova] Creating event network-changed:ed94d36a-868e-4de5-a346-139f9947c086 for instance d729ee22-6dee-45a8-8460-14230cc47c0e on hv-cinder-84617 Jul 28 18:20:50.713389 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-64bd6c91-c793-4092-9cbb-12ced58d70f4 req-7dc83d35-9fad-4aea-a549-9649bfaa9e57 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030417 Jul 28 18:20:50.714559 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 394/788] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:20:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:20:52.961641 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-f1184ca9-34fc-4d32-8541-3adcfe75feb4 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-540648921", "imageRef": "61912422-61cd-4ced-a573-85ee305e010f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "44a25a1e-08cb-4158-9e81-b93066923b4d"}], "security_groups": [{"name": "tempest-securitygroup--90581965"}], "key_name": "tempest-keypair-1954542310", "user_data": "}} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:20:53.066526 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.network.neutron [None req-f1184ca9-34fc-4d32-8541-3adcfe75feb4 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] validate_networks() for [('44a25a1e-08cb-4158-9e81-b93066923b4d', None, None, None, None, None)] {{(pid=118454) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 18:20:53.471462 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.virt.hardware [None req-f1184ca9-34fc-4d32-8541-3adcfe75feb4 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Flavor limits 0:0:0 {{(pid=118454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 18:20:53.471890 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.virt.hardware [None req-f1184ca9-34fc-4d32-8541-3adcfe75feb4 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Image limits 0:0:0 {{(pid=118454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 18:20:53.472365 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.virt.hardware [None req-f1184ca9-34fc-4d32-8541-3adcfe75feb4 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Flavor pref 0:0:0 {{(pid=118454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 18:20:53.472936 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.virt.hardware [None req-f1184ca9-34fc-4d32-8541-3adcfe75feb4 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Image pref 0:0:0 {{(pid=118454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 18:20:53.473206 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.virt.hardware [None req-f1184ca9-34fc-4d32-8541-3adcfe75feb4 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 18:20:53.485085 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f1184ca9-34fc-4d32-8541-3adcfe75feb4 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:53.485790 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f1184ca9-34fc-4d32-8541-3adcfe75feb4 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:53.486977 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f1184ca9-34fc-4d32-8541-3adcfe75feb4 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:53.487495 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f1184ca9-34fc-4d32-8541-3adcfe75feb4 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:53.505884 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.quota [None req-f1184ca9-34fc-4d32-8541-3adcfe75feb4 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Getting quotas for project 104313ce72c94ea68c8cd3ee7f0cab2e. Resources: {'cores', 'ram', 'instances'} {{(pid=118454) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 18:20:53.510004 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.quota [None req-f1184ca9-34fc-4d32-8541-3adcfe75feb4 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Getting quotas for user e2b1f1c4bb2747e0845cdc2991e53b09 and project 104313ce72c94ea68c8cd3ee7f0cab2e. Resources: {'cores', 'ram', 'instances'} {{(pid=118454) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 18:20:53.522898 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-f1184ca9-34fc-4d32-8541-3adcfe75feb4 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Going to run 1 instances... {{(pid=118454) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 18:20:53.525116 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-f1184ca9-34fc-4d32-8541-3adcfe75feb4 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: 1b4d9d7f-8b12-4bfa-83a0-e55a8422d754] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='61912422-61cd-4ced-a573-85ee305e010f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118454) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 18:20:53.665539 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-f1184ca9-34fc-4d32-8541-3adcfe75feb4 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.708771 Jul 28 18:20:53.666204 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 395/789] 10.222.0.86 () {60 vars in 1147 bytes} [Thu Jul 28 18:20:52 2022] POST /compute/v2.1/servers => generated 400 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 18:20:53.678469 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0dd16100-8b2e-45d8-aeea-19f556ca65eb tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:20:53.679283 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0dd16100-8b2e-45d8-aeea-19f556ca65eb tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: 1b4d9d7f-8b12-4bfa-83a0-e55a8422d754] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:20:53.755316 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-0dd16100-8b2e-45d8-aeea-19f556ca65eb tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:53.763575 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0dd16100-8b2e-45d8-aeea-19f556ca65eb tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/1b4d9d7f-8b12-4bfa-83a0-e55a8422d754" status: 200 len: 1241 microversion: 2.1 time: 0.089747 Jul 28 18:20:53.764378 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 395/790] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:20:53 2022] GET /compute/v2.1/servers/1b4d9d7f-8b12-4bfa-83a0-e55a8422d754 => generated 1241 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:20:54.784276 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-6715ccc0-b31c-48f9-8054-ddf01bb2fe82 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:20:54.784899 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-6715ccc0-b31c-48f9-8054-ddf01bb2fe82 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: 1b4d9d7f-8b12-4bfa-83a0-e55a8422d754] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:20:54.791254 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-6715ccc0-b31c-48f9-8054-ddf01bb2fe82 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:54.791731 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-6715ccc0-b31c-48f9-8054-ddf01bb2fe82 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:54.792501 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-6715ccc0-b31c-48f9-8054-ddf01bb2fe82 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:54.792935 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-6715ccc0-b31c-48f9-8054-ddf01bb2fe82 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:54.856278 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-6715ccc0-b31c-48f9-8054-ddf01bb2fe82 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:54.864506 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-6715ccc0-b31c-48f9-8054-ddf01bb2fe82 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/1b4d9d7f-8b12-4bfa-83a0-e55a8422d754" status: 200 len: 1245 microversion: 2.1 time: 0.084751 Jul 28 18:20:54.865100 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 396/791] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:20:54 2022] GET /compute/v2.1/servers/1b4d9d7f-8b12-4bfa-83a0-e55a8422d754 => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:20:55.885219 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5caee8d1-0797-4f87-8978-5d8df3c818bf tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:20:55.885893 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-5caee8d1-0797-4f87-8978-5d8df3c818bf tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: 1b4d9d7f-8b12-4bfa-83a0-e55a8422d754] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:20:55.894158 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5caee8d1-0797-4f87-8978-5d8df3c818bf tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:55.894613 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5caee8d1-0797-4f87-8978-5d8df3c818bf tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:55.895439 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5caee8d1-0797-4f87-8978-5d8df3c818bf tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:55.895868 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5caee8d1-0797-4f87-8978-5d8df3c818bf tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:55.963585 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-5caee8d1-0797-4f87-8978-5d8df3c818bf tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:55.971560 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-5caee8d1-0797-4f87-8978-5d8df3c818bf tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/1b4d9d7f-8b12-4bfa-83a0-e55a8422d754" status: 200 len: 1301 microversion: 2.1 time: 0.090440 Jul 28 18:20:55.972138 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 396/792] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:20:55 2022] GET /compute/v2.1/servers/1b4d9d7f-8b12-4bfa-83a0-e55a8422d754 => generated 1301 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:20:56.993303 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-07dff72b-cee6-4be6-b3a8-e92bb7df2f09 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:20:56.993849 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-07dff72b-cee6-4be6-b3a8-e92bb7df2f09 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: 1b4d9d7f-8b12-4bfa-83a0-e55a8422d754] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:20:57.000254 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-07dff72b-cee6-4be6-b3a8-e92bb7df2f09 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:57.000700 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-07dff72b-cee6-4be6-b3a8-e92bb7df2f09 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:57.001500 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-07dff72b-cee6-4be6-b3a8-e92bb7df2f09 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:57.001933 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-07dff72b-cee6-4be6-b3a8-e92bb7df2f09 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:57.019914 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:20:57.146521 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-07dff72b-cee6-4be6-b3a8-e92bb7df2f09 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:57.154435 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-07dff72b-cee6-4be6-b3a8-e92bb7df2f09 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/1b4d9d7f-8b12-4bfa-83a0-e55a8422d754" status: 200 len: 1365 microversion: 2.1 time: 0.165116 Jul 28 18:20:57.155020 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 397/793] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:20:56 2022] GET /compute/v2.1/servers/1b4d9d7f-8b12-4bfa-83a0-e55a8422d754 => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:20:57.572581 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-60d17c6e-716f-4f02-8163-9727bee7b05b req-216ebe93-bdce-4ec4-9256-20aafa0c207f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b4d9d7f-8b12-4bfa-83a0-e55a8422d754", "tag": "61aa0381-f0f3-4341-9fdf-0aba5beb4f6a"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:20:57.583270 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-60d17c6e-716f-4f02-8163-9727bee7b05b req-216ebe93-bdce-4ec4-9256-20aafa0c207f service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:57.583892 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-60d17c6e-716f-4f02-8163-9727bee7b05b req-216ebe93-bdce-4ec4-9256-20aafa0c207f service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:57.602496 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-60d17c6e-716f-4f02-8163-9727bee7b05b req-216ebe93-bdce-4ec4-9256-20aafa0c207f service nova] Creating event network-changed:61aa0381-f0f3-4341-9fdf-0aba5beb4f6a for instance 1b4d9d7f-8b12-4bfa-83a0-e55a8422d754 on hv-cinder-84617 Jul 28 18:20:57.607598 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-60d17c6e-716f-4f02-8163-9727bee7b05b req-216ebe93-bdce-4ec4-9256-20aafa0c207f service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040272 Jul 28 18:20:57.609960 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 397/794] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:20:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:20:58.175262 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-a6f0dd5f-9b74-4f8a-9e90-5fd3d238df46 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:20:58.175867 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-a6f0dd5f-9b74-4f8a-9e90-5fd3d238df46 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: 1b4d9d7f-8b12-4bfa-83a0-e55a8422d754] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:20:58.182339 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a6f0dd5f-9b74-4f8a-9e90-5fd3d238df46 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:58.182786 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a6f0dd5f-9b74-4f8a-9e90-5fd3d238df46 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:58.183552 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a6f0dd5f-9b74-4f8a-9e90-5fd3d238df46 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:58.184161 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a6f0dd5f-9b74-4f8a-9e90-5fd3d238df46 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:58.318856 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-a6f0dd5f-9b74-4f8a-9e90-5fd3d238df46 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:58.326779 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-a6f0dd5f-9b74-4f8a-9e90-5fd3d238df46 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/1b4d9d7f-8b12-4bfa-83a0-e55a8422d754" status: 200 len: 1365 microversion: 2.1 time: 0.155423 Jul 28 18:20:58.327351 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 398/795] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:20:58 2022] GET /compute/v2.1/servers/1b4d9d7f-8b12-4bfa-83a0-e55a8422d754 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:20:59.349330 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-7a258170-7a25-4705-b680-b94cb73f1967 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:20:59.350025 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-7a258170-7a25-4705-b680-b94cb73f1967 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: 1b4d9d7f-8b12-4bfa-83a0-e55a8422d754] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:20:59.356506 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7a258170-7a25-4705-b680-b94cb73f1967 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:59.357011 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7a258170-7a25-4705-b680-b94cb73f1967 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:59.357748 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7a258170-7a25-4705-b680-b94cb73f1967 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:20:59.358184 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7a258170-7a25-4705-b680-b94cb73f1967 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:20:59.492608 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-7a258170-7a25-4705-b680-b94cb73f1967 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:20:59.500554 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-7a258170-7a25-4705-b680-b94cb73f1967 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/1b4d9d7f-8b12-4bfa-83a0-e55a8422d754" status: 200 len: 1365 microversion: 2.1 time: 0.156014 Jul 28 18:20:59.501151 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 398/796] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:20:59 2022] GET /compute/v2.1/servers/1b4d9d7f-8b12-4bfa-83a0-e55a8422d754 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:21:00.521908 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-a455b1e3-0af5-474b-abda-0070c4951181 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:00.522446 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-a455b1e3-0af5-474b-abda-0070c4951181 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: 1b4d9d7f-8b12-4bfa-83a0-e55a8422d754] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:00.528890 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a455b1e3-0af5-474b-abda-0070c4951181 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:00.529877 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a455b1e3-0af5-474b-abda-0070c4951181 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:00.530630 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a455b1e3-0af5-474b-abda-0070c4951181 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:00.531069 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a455b1e3-0af5-474b-abda-0070c4951181 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:00.661116 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-a455b1e3-0af5-474b-abda-0070c4951181 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:00.668481 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-a455b1e3-0af5-474b-abda-0070c4951181 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/1b4d9d7f-8b12-4bfa-83a0-e55a8422d754" status: 200 len: 1365 microversion: 2.1 time: 0.150439 Jul 28 18:21:00.669068 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 399/797] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:21:00 2022] GET /compute/v2.1/servers/1b4d9d7f-8b12-4bfa-83a0-e55a8422d754 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:21:01.268446 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0a490fac-5b6b-4b4a-92d6-7aee3c4ff5d6 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:01.268955 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0a490fac-5b6b-4b4a-92d6-7aee3c4ff5d6 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: 60bf3b10-9241-4fb1-9543-46147477634d] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:01.275666 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0a490fac-5b6b-4b4a-92d6-7aee3c4ff5d6 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:01.276117 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0a490fac-5b6b-4b4a-92d6-7aee3c4ff5d6 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:01.276908 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0a490fac-5b6b-4b4a-92d6-7aee3c4ff5d6 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:01.277369 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0a490fac-5b6b-4b4a-92d6-7aee3c4ff5d6 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:01.302165 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0a490fac-5b6b-4b4a-92d6-7aee3c4ff5d6 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: 60bf3b10-9241-4fb1-9543-46147477634d] Going to try to terminate instance {{(pid=118453) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 18:21:01.415623 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:21:01.587162 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0a490fac-5b6b-4b4a-92d6-7aee3c4ff5d6 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "DELETE /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d" status: 204 len: 0 microversion: 2.1 time: 0.322329 Jul 28 18:21:01.587761 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 399/798] 10.222.0.86 () {58 vars in 1239 bytes} [Thu Jul 28 18:21:01 2022] DELETE /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 18:21:01.596623 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-cc246f68-d369-4314-9581-7cb5959a4277 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:01.597284 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-cc246f68-d369-4314-9581-7cb5959a4277 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: 60bf3b10-9241-4fb1-9543-46147477634d] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:01.603763 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-cc246f68-d369-4314-9581-7cb5959a4277 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:01.604208 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-cc246f68-d369-4314-9581-7cb5959a4277 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:01.604987 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-cc246f68-d369-4314-9581-7cb5959a4277 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:01.605416 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-cc246f68-d369-4314-9581-7cb5959a4277 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:01.689521 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-09b7fc12-e3c0-4b8d-96cd-0da0d0d3857e tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:01.690365 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-09b7fc12-e3c0-4b8d-96cd-0da0d0d3857e tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: 1b4d9d7f-8b12-4bfa-83a0-e55a8422d754] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:01.696794 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-09b7fc12-e3c0-4b8d-96cd-0da0d0d3857e tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:01.697400 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-09b7fc12-e3c0-4b8d-96cd-0da0d0d3857e tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:01.698226 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-09b7fc12-e3c0-4b8d-96cd-0da0d0d3857e tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:01.698736 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-09b7fc12-e3c0-4b8d-96cd-0da0d0d3857e tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:01.752558 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-cc246f68-d369-4314-9581-7cb5959a4277 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:01.761294 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-cc246f68-d369-4314-9581-7cb5959a4277 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d" status: 200 len: 1576 microversion: 2.1 time: 0.168542 Jul 28 18:21:01.761871 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 400/799] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:21:01 2022] GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d => generated 1576 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:21:01.837264 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-09b7fc12-e3c0-4b8d-96cd-0da0d0d3857e tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:01.845671 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-09b7fc12-e3c0-4b8d-96cd-0da0d0d3857e tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/1b4d9d7f-8b12-4bfa-83a0-e55a8422d754" status: 200 len: 1365 microversion: 2.1 time: 0.160691 Jul 28 18:21:01.846231 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 400/800] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:21:01 2022] GET /compute/v2.1/servers/1b4d9d7f-8b12-4bfa-83a0-e55a8422d754 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:21:02.782886 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-385df2c3-7f73-4ede-a5c8-23724f40e489 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:02.783569 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-385df2c3-7f73-4ede-a5c8-23724f40e489 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: 60bf3b10-9241-4fb1-9543-46147477634d] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:02.789768 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-385df2c3-7f73-4ede-a5c8-23724f40e489 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:02.790226 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-385df2c3-7f73-4ede-a5c8-23724f40e489 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:02.790991 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-385df2c3-7f73-4ede-a5c8-23724f40e489 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:02.791441 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-385df2c3-7f73-4ede-a5c8-23724f40e489 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:02.866688 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-646751fa-a464-489a-875f-eda32fcc21b4 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:02.867459 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-646751fa-a464-489a-875f-eda32fcc21b4 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: 1b4d9d7f-8b12-4bfa-83a0-e55a8422d754] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:02.874625 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-646751fa-a464-489a-875f-eda32fcc21b4 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:02.875094 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-646751fa-a464-489a-875f-eda32fcc21b4 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:02.875870 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-646751fa-a464-489a-875f-eda32fcc21b4 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:02.876311 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-646751fa-a464-489a-875f-eda32fcc21b4 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:02.930948 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-385df2c3-7f73-4ede-a5c8-23724f40e489 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:02.939246 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-385df2c3-7f73-4ede-a5c8-23724f40e489 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d" status: 200 len: 1576 microversion: 2.1 time: 0.160237 Jul 28 18:21:02.939819 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 401/801] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:21:02 2022] GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:21:03.017086 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-646751fa-a464-489a-875f-eda32fcc21b4 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:03.024407 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-646751fa-a464-489a-875f-eda32fcc21b4 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/1b4d9d7f-8b12-4bfa-83a0-e55a8422d754" status: 200 len: 1365 microversion: 2.1 time: 0.161544 Jul 28 18:21:03.024984 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 401/802] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:21:02 2022] GET /compute/v2.1/servers/1b4d9d7f-8b12-4bfa-83a0-e55a8422d754 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:21:03.960516 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-cd73a452-edcb-4ef9-9411-097422a807e1 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:03.961164 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-cd73a452-edcb-4ef9-9411-097422a807e1 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: 60bf3b10-9241-4fb1-9543-46147477634d] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:03.963018 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell0:SELECT=2 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:21:03.964391 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell0:SELECT=10 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:21:03.970334 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-cd73a452-edcb-4ef9-9411-097422a807e1 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:03.970796 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-cd73a452-edcb-4ef9-9411-097422a807e1 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:03.971573 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-cd73a452-edcb-4ef9-9411-097422a807e1 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:03.972193 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-cd73a452-edcb-4ef9-9411-097422a807e1 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:04.049189 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-6bb66f61-4656-439e-8fb7-52891bd423ac tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:04.054341 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-6bb66f61-4656-439e-8fb7-52891bd423ac tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: 1b4d9d7f-8b12-4bfa-83a0-e55a8422d754] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:04.067078 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell0:SELECT=2 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:21:04.077136 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6bb66f61-4656-439e-8fb7-52891bd423ac tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:04.077769 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6bb66f61-4656-439e-8fb7-52891bd423ac tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:04.081795 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6bb66f61-4656-439e-8fb7-52891bd423ac tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:04.081795 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6bb66f61-4656-439e-8fb7-52891bd423ac tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:04.181659 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-cd73a452-edcb-4ef9-9411-097422a807e1 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:04.196842 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-cd73a452-edcb-4ef9-9411-097422a807e1 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d" status: 200 len: 1576 microversion: 2.1 time: 0.238966 Jul 28 18:21:04.201729 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 402/803] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:21:03 2022] GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d => generated 1576 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:21:04.266409 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-6bb66f61-4656-439e-8fb7-52891bd423ac tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:04.274043 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-6bb66f61-4656-439e-8fb7-52891bd423ac tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/1b4d9d7f-8b12-4bfa-83a0-e55a8422d754" status: 200 len: 1365 microversion: 2.1 time: 0.232651 Jul 28 18:21:04.274840 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 402/804] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:21:04 2022] GET /compute/v2.1/servers/1b4d9d7f-8b12-4bfa-83a0-e55a8422d754 => generated 1365 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:21:04.750098 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [req-4afb2ab5-cd4b-4c07-83c2-8a031b82fe5a req-0f8c9b28-73cb-4811-b7aa-18fdaeb4c416 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60bf3b10-9241-4fb1-9543-46147477634d", "name": "network-vif-deleted", "tag": "c9c5491c-fa11-47ad-bc68-d27692005b9b"}]} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:21:04.765563 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-4afb2ab5-cd4b-4c07-83c2-8a031b82fe5a req-0f8c9b28-73cb-4811-b7aa-18fdaeb4c416 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:04.766087 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-4afb2ab5-cd4b-4c07-83c2-8a031b82fe5a req-0f8c9b28-73cb-4811-b7aa-18fdaeb4c416 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:04.777461 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.compute.server_external_events [req-4afb2ab5-cd4b-4c07-83c2-8a031b82fe5a req-0f8c9b28-73cb-4811-b7aa-18fdaeb4c416 service nova] Creating event network-vif-deleted:c9c5491c-fa11-47ad-bc68-d27692005b9b for instance 60bf3b10-9241-4fb1-9543-46147477634d on hv-cinder-84617 Jul 28 18:21:04.782764 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [req-4afb2ab5-cd4b-4c07-83c2-8a031b82fe5a req-0f8c9b28-73cb-4811-b7aa-18fdaeb4c416 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036787 Jul 28 18:21:04.783490 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 403/805] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:21:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:21:05.219458 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f8a68f6a-2152-4eb2-8b52-45565546b65b tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:05.220437 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f8a68f6a-2152-4eb2-8b52-45565546b65b tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: 60bf3b10-9241-4fb1-9543-46147477634d] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:05.228049 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f8a68f6a-2152-4eb2-8b52-45565546b65b tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:05.228498 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f8a68f6a-2152-4eb2-8b52-45565546b65b tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:05.229310 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f8a68f6a-2152-4eb2-8b52-45565546b65b tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:05.229746 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f8a68f6a-2152-4eb2-8b52-45565546b65b tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:05.298138 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-8790bbcd-9816-47c1-b968-dcabcc6e3c78 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:05.299429 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-8790bbcd-9816-47c1-b968-dcabcc6e3c78 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: 1b4d9d7f-8b12-4bfa-83a0-e55a8422d754] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:05.302922 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f8a68f6a-2152-4eb2-8b52-45565546b65b tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:05.306476 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-8790bbcd-9816-47c1-b968-dcabcc6e3c78 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:05.307564 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-8790bbcd-9816-47c1-b968-dcabcc6e3c78 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:05.308604 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-8790bbcd-9816-47c1-b968-dcabcc6e3c78 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:05.309338 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-8790bbcd-9816-47c1-b968-dcabcc6e3c78 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:05.313759 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f8a68f6a-2152-4eb2-8b52-45565546b65b tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d" status: 200 len: 1224 microversion: 2.1 time: 0.098034 Jul 28 18:21:05.316467 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 403/806] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:21:05 2022] GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d => generated 1224 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:21:05.454796 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-8790bbcd-9816-47c1-b968-dcabcc6e3c78 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:05.462648 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-8790bbcd-9816-47c1-b968-dcabcc6e3c78 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/1b4d9d7f-8b12-4bfa-83a0-e55a8422d754" status: 200 len: 1365 microversion: 2.1 time: 0.170883 Jul 28 18:21:05.466856 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 404/807] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:21:05 2022] GET /compute/v2.1/servers/1b4d9d7f-8b12-4bfa-83a0-e55a8422d754 => generated 1365 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:21:06.336073 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-15aa5888-f0c7-4cf4-af69-d8befca49d21 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:06.336620 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-15aa5888-f0c7-4cf4-af69-d8befca49d21 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: 60bf3b10-9241-4fb1-9543-46147477634d] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:06.344376 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-15aa5888-f0c7-4cf4-af69-d8befca49d21 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:06.344831 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-15aa5888-f0c7-4cf4-af69-d8befca49d21 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:06.345641 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-15aa5888-f0c7-4cf4-af69-d8befca49d21 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:06.346082 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-15aa5888-f0c7-4cf4-af69-d8befca49d21 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:06.360074 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.wsgi [None req-15aa5888-f0c7-4cf4-af69-d8befca49d21 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] HTTP exception thrown: Instance 60bf3b10-9241-4fb1-9543-46147477634d could not be found. Jul 28 18:21:06.361810 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-15aa5888-f0c7-4cf4-af69-d8befca49d21 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Request method failure captured: Jul 28 18:21:06.361810 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: request: GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d HTTP/1.1 Jul 28 18:21:06.361810 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Accept: application/json Jul 28 18:21:06.361810 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Accept-Encoding: identity Jul 28 18:21:06.361810 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Connection: close Jul 28 18:21:06.361810 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Content-Length: 0 Jul 28 18:21:06.361810 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Content-Type: application/json Jul 28 18:21:06.361810 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Host: 10.222.0.86 Jul 28 18:21:06.361810 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Openstack-System-Scope: None Jul 28 18:21:06.361810 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: User-Agent: python-urllib3/1.26.10 Jul 28 18:21:06.361810 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Auth-Token: gAAAAABi4tKADOyNlfFwikUXw-WoMifZZxpuvbn7JEeADT74_QvGJt-yMXp_KjT-wzXh_xsMzVwyamDANEYjyiJOBNQ4yK1rS_2YPrT65yaFJQ7qKd6YMsNdRwJF1cZSND6GICiEmHRtehHzhyztHZ7oy5jLyY2bzXs6UaP_cXT2a3nqBTni7Ec Jul 28 18:21:06.361810 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Domain-Id: None Jul 28 18:21:06.361810 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Domain-Name: None Jul 28 18:21:06.361810 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Identity-Status: Confirmed Jul 28 18:21:06.361810 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Is-Admin-Project: True Jul 28 18:21:06.361810 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Id: default Jul 28 18:21:06.361810 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Name: Default Jul 28 18:21:06.361810 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Id: 308e6cf086ae4cdea9c591ed2811c976 Jul 28 18:21:06.361810 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Name: tempest-TestVolumeBootPattern-2035805745 Jul 28 18:21:06.361810 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Role: member,reader Jul 28 18:21:06.361810 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Roles: member,reader Jul 28 18:21:06.363478 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_308e6cf086ae4cdea9c591ed2811c976"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/308e6cf086ae4cdea9c591ed2811c976"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/308e6cf086ae4cdea9c591ed2811c976"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/308e6cf086ae4cdea9c591ed2811c976"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}] Jul 28 18:21:06.363478 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant: tempest-TestVolumeBootPattern-2035805745 Jul 28 18:21:06.363478 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant-Id: 308e6cf086ae4cdea9c591ed2811c976 Jul 28 18:21:06.363478 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant-Name: tempest-TestVolumeBootPattern-2035805745 Jul 28 18:21:06.363478 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User: tempest-TestVolumeBootPattern-2035805745-project Jul 28 18:21:06.363478 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Id: default Jul 28 18:21:06.363478 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Name: Default Jul 28 18:21:06.363478 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Id: 30f0002d2a5a4950b2f1aa771f33bbc1 Jul 28 18:21:06.363478 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Name: tempest-TestVolumeBootPattern-2035805745-project Jul 28 18:21:06.363478 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: method: > Jul 28 18:21:06.363478 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: exception: Instance 60bf3b10-9241-4fb1-9543-46147477634d could not be found. Jul 28 18:21:06.363478 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: action_args: {'id': '60bf3b10-9241-4fb1-9543-46147477634d'} Jul 28 18:21:06.364621 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:21:06.364621 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:21:06.364621 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:21:06.364621 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:21:06.364621 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:21:06.364621 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:21:06.364621 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:21:06.364621 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:21:06.364621 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:21:06.364621 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:21:06.364621 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60bf3b10-9241-4fb1-9543-46147477634d could not be found. Jul 28 18:21:06.364621 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:21:06.364621 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:21:06.364621 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:21:06.364621 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:21:06.364621 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:21:06.364621 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:21:06.364621 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:21:06.364621 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:21:06.364621 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:21:06.365976 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:21:06.365976 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 18:21:06.365976 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 18:21:06.365976 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:21:06.365976 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:21:06.365976 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:21:06.365976 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:21:06.365976 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60bf3b10-9241-4fb1-9543-46147477634d could not be found. Jul 28 18:21:06.365976 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:21:06.365976 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:21:06.365976 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:21:06.365976 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:21:06.365976 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:21:06.365976 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:21:06.365976 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:21:06.365976 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:21:06.365976 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60bf3b10-9241-4fb1-9543-46147477634d could not be found. Jul 28 18:21:06.365976 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:21:06.367114 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-15aa5888-f0c7-4cf4-af69-d8befca49d21 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Returning 404 to user: Instance 60bf3b10-9241-4fb1-9543-46147477634d could not be found. {{(pid=118453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:21:06.367114 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-15aa5888-f0c7-4cf4-af69-d8befca49d21 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d" status: 404 len: 111 microversion: 2.1 time: 0.031143 Jul 28 18:21:06.367114 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 404/808] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:21:06 2022] GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:21:06.415908 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [req-3880c0cc-856d-4dd4-8052-c69262643524 req-f5cfde48-2263-441f-829c-24ba402c19f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b4d9d7f-8b12-4bfa-83a0-e55a8422d754", "name": "network-vif-plugged", "status": "completed", "tag": "61aa0381-f0f3-4341-9fdf-0aba5beb4f6a"}]} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:21:06.430812 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-3880c0cc-856d-4dd4-8052-c69262643524 req-f5cfde48-2263-441f-829c-24ba402c19f6 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:06.431264 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-3880c0cc-856d-4dd4-8052-c69262643524 req-f5cfde48-2263-441f-829c-24ba402c19f6 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:06.442479 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.compute.server_external_events [req-3880c0cc-856d-4dd4-8052-c69262643524 req-f5cfde48-2263-441f-829c-24ba402c19f6 service nova] Creating event network-vif-plugged:61aa0381-f0f3-4341-9fdf-0aba5beb4f6a for instance 1b4d9d7f-8b12-4bfa-83a0-e55a8422d754 on hv-cinder-84617 Jul 28 18:21:06.447343 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [req-3880c0cc-856d-4dd4-8052-c69262643524 req-f5cfde48-2263-441f-829c-24ba402c19f6 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035930 Jul 28 18:21:06.447950 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 405/809] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:21:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:21:06.470719 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0f689433-40bb-4db0-bd08-6257dd64b131 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-963953819", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-554928045", "security_groups": [{"name": "tempest-secgroup-smoke-370419790"}], "block_device_mapping_v2": [{"uuid": "ff03e33d-d90d-4d7c-9fc7-360ac245c4a7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f4b4861e-a1c6-45e0-a934-67c667a84812"}]}} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:21:06.484387 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-0ecdc522-4b5c-4122-bf1b-39f500763300 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:06.485157 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-0ecdc522-4b5c-4122-bf1b-39f500763300 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: 1b4d9d7f-8b12-4bfa-83a0-e55a8422d754] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:06.491442 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-0ecdc522-4b5c-4122-bf1b-39f500763300 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:06.491983 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-0ecdc522-4b5c-4122-bf1b-39f500763300 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:06.492944 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-0ecdc522-4b5c-4122-bf1b-39f500763300 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:06.493415 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-0ecdc522-4b5c-4122-bf1b-39f500763300 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:06.643714 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.network.neutron [None req-0f689433-40bb-4db0-bd08-6257dd64b131 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] validate_networks() for [('f4b4861e-a1c6-45e0-a934-67c667a84812', None, None, None, None, None)] {{(pid=118453) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 18:21:06.727389 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-0ecdc522-4b5c-4122-bf1b-39f500763300 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:06.735081 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-0ecdc522-4b5c-4122-bf1b-39f500763300 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/1b4d9d7f-8b12-4bfa-83a0-e55a8422d754" status: 200 len: 1365 microversion: 2.1 time: 0.255116 Jul 28 18:21:06.735661 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 406/810] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:21:06 2022] GET /compute/v2.1/servers/1b4d9d7f-8b12-4bfa-83a0-e55a8422d754 => generated 1365 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:21:07.037889 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-0f689433-40bb-4db0-bd08-6257dd64b131 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Flavor limits 0:0:0 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 18:21:07.038316 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-0f689433-40bb-4db0-bd08-6257dd64b131 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Image limits 0:0:0 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 18:21:07.038789 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-0f689433-40bb-4db0-bd08-6257dd64b131 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Flavor pref 0:0:0 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 18:21:07.039197 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-0f689433-40bb-4db0-bd08-6257dd64b131 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Image pref 0:0:0 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 18:21:07.039607 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-0f689433-40bb-4db0-bd08-6257dd64b131 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 18:21:07.049066 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0f689433-40bb-4db0-bd08-6257dd64b131 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:07.049513 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0f689433-40bb-4db0-bd08-6257dd64b131 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:07.050309 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0f689433-40bb-4db0-bd08-6257dd64b131 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:07.050747 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0f689433-40bb-4db0-bd08-6257dd64b131 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:07.067607 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.quota [None req-0f689433-40bb-4db0-bd08-6257dd64b131 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Getting quotas for project 308e6cf086ae4cdea9c591ed2811c976. Resources: {'cores', 'ram', 'instances'} {{(pid=118453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 18:21:07.071528 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.quota [None req-0f689433-40bb-4db0-bd08-6257dd64b131 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Getting quotas for user 30f0002d2a5a4950b2f1aa771f33bbc1 and project 308e6cf086ae4cdea9c591ed2811c976. Resources: {'cores', 'ram', 'instances'} {{(pid=118453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 18:21:07.128128 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0f689433-40bb-4db0-bd08-6257dd64b131 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Going to run 1 instances... {{(pid=118453) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 18:21:07.130231 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0f689433-40bb-4db0-bd08-6257dd64b131 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: cc02a9d1-d99e-4119-b12f-63effaab3d40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ff03e33d-d90d-4d7c-9fc7-360ac245c4a7',volume_size=None,volume_type=None)] {{(pid=118453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 18:21:07.240683 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-88f46553-f966-4bc5-a618-021ebac149a6 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:21:07.241263 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-88f46553-f966-4bc5-a618-021ebac149a6 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:07.247245 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-88f46553-f966-4bc5-a618-021ebac149a6 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:07.247718 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-88f46553-f966-4bc5-a618-021ebac149a6 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:07.249093 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-88f46553-f966-4bc5-a618-021ebac149a6 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:07.249531 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-88f46553-f966-4bc5-a618-021ebac149a6 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:07.271568 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.objects.instance [None req-88f46553-f966-4bc5-a618-021ebac149a6 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lazy-loading 'flavor' on Instance uuid eb0a115f-17bf-4501-af27-0802f70ac213 {{(pid=118454) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:21:07.543498 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0f689433-40bb-4db0-bd08-6257dd64b131 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.077058 Jul 28 18:21:07.544346 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 405/811] 10.222.0.86 () {60 vars in 1147 bytes} [Thu Jul 28 18:21:06 2022] POST /compute/v2.1/servers => generated 405 bytes in 1078 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 18:21:07.555114 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-422a1e9b-f78c-4e6c-9bf2-0cf169429d7b tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:07.555713 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-422a1e9b-f78c-4e6c-9bf2-0cf169429d7b tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: cc02a9d1-d99e-4119-b12f-63effaab3d40] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:07.570761 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-88f46553-f966-4bc5-a618-021ebac149a6 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "POST /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213/action" status: 202 len: 0 microversion: 2.1 time: 0.333914 Jul 28 18:21:07.571686 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 407/812] 10.222.0.86 () {60 vars in 1278 bytes} [Thu Jul 28 18:21:07 2022] POST /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213/action => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 18:21:07.580219 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-194b05f3-c309-40a5-b47d-d18d0d215bfe tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:07.581273 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-194b05f3-c309-40a5-b47d-d18d0d215bfe tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:07.588196 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-194b05f3-c309-40a5-b47d-d18d0d215bfe tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:07.588734 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-194b05f3-c309-40a5-b47d-d18d0d215bfe tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:07.590005 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-194b05f3-c309-40a5-b47d-d18d0d215bfe tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:07.590605 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-194b05f3-c309-40a5-b47d-d18d0d215bfe tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:07.617394 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-422a1e9b-f78c-4e6c-9bf2-0cf169429d7b tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:07.624277 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-422a1e9b-f78c-4e6c-9bf2-0cf169429d7b tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/cc02a9d1-d99e-4119-b12f-63effaab3d40" status: 200 len: 1093 microversion: 2.1 time: 0.072794 Jul 28 18:21:07.625751 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 406/813] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:21:07 2022] GET /compute/v2.1/servers/cc02a9d1-d99e-4119-b12f-63effaab3d40 => generated 1093 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:21:07.730606 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-194b05f3-c309-40a5-b47d-d18d0d215bfe tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba025a383c433b900a3f4ae64959b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf347b1959b247bcbe003ac3662cb239', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:07.738771 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-194b05f3-c309-40a5-b47d-d18d0d215bfe tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213" status: 200 len: 1568 microversion: 2.1 time: 0.162677 Jul 28 18:21:07.739441 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 408/814] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:21:07 2022] GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:21:07.755731 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-62346cfe-a6ba-4528-b462-d05707217781 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:07.756378 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-62346cfe-a6ba-4528-b462-d05707217781 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: 1b4d9d7f-8b12-4bfa-83a0-e55a8422d754] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:07.762563 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-62346cfe-a6ba-4528-b462-d05707217781 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:07.763153 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-62346cfe-a6ba-4528-b462-d05707217781 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:07.763975 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-62346cfe-a6ba-4528-b462-d05707217781 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:07.764417 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-62346cfe-a6ba-4528-b462-d05707217781 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:07.899139 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-62346cfe-a6ba-4528-b462-d05707217781 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:07.907657 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-62346cfe-a6ba-4528-b462-d05707217781 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/1b4d9d7f-8b12-4bfa-83a0-e55a8422d754" status: 200 len: 1365 microversion: 2.1 time: 0.155957 Jul 28 18:21:07.908234 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 407/815] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:21:07 2022] GET /compute/v2.1/servers/1b4d9d7f-8b12-4bfa-83a0-e55a8422d754 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:21:08.645755 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-8c593017-8ba5-4bea-97b6-5aa0085acb37 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:08.646366 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-8c593017-8ba5-4bea-97b6-5aa0085acb37 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: cc02a9d1-d99e-4119-b12f-63effaab3d40] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:08.652849 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-8c593017-8ba5-4bea-97b6-5aa0085acb37 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:08.653407 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-8c593017-8ba5-4bea-97b6-5aa0085acb37 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:08.654250 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-8c593017-8ba5-4bea-97b6-5aa0085acb37 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:08.654697 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-8c593017-8ba5-4bea-97b6-5aa0085acb37 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:08.714297 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-8c593017-8ba5-4bea-97b6-5aa0085acb37 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:08.721743 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-8c593017-8ba5-4bea-97b6-5aa0085acb37 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/cc02a9d1-d99e-4119-b12f-63effaab3d40" status: 200 len: 1143 microversion: 2.1 time: 0.080137 Jul 28 18:21:08.722310 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 409/816] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:21:08 2022] GET /compute/v2.1/servers/cc02a9d1-d99e-4119-b12f-63effaab3d40 => generated 1143 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:21:08.759649 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-bdb64e13-0a7b-4b5d-b74a-b77f38a35ae3 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:08.760260 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-bdb64e13-0a7b-4b5d-b74a-b77f38a35ae3 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:08.766872 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bdb64e13-0a7b-4b5d-b74a-b77f38a35ae3 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:08.767359 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bdb64e13-0a7b-4b5d-b74a-b77f38a35ae3 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:08.768118 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bdb64e13-0a7b-4b5d-b74a-b77f38a35ae3 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:08.768554 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bdb64e13-0a7b-4b5d-b74a-b77f38a35ae3 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:08.899922 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-bdb64e13-0a7b-4b5d-b74a-b77f38a35ae3 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba025a383c433b900a3f4ae64959b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf347b1959b247bcbe003ac3662cb239', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:08.907560 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-bdb64e13-0a7b-4b5d-b74a-b77f38a35ae3 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213" status: 200 len: 1568 microversion: 2.1 time: 0.151763 Jul 28 18:21:08.908132 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 408/817] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:21:08 2022] GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:21:08.928364 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-eb7d10e3-1d69-46d0-a56f-639d7d9d8843 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:08.929016 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-eb7d10e3-1d69-46d0-a56f-639d7d9d8843 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: 1b4d9d7f-8b12-4bfa-83a0-e55a8422d754] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:08.934966 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-eb7d10e3-1d69-46d0-a56f-639d7d9d8843 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:08.936045 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-eb7d10e3-1d69-46d0-a56f-639d7d9d8843 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:08.936814 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-eb7d10e3-1d69-46d0-a56f-639d7d9d8843 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:08.937282 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-eb7d10e3-1d69-46d0-a56f-639d7d9d8843 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:09.063397 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-eb7d10e3-1d69-46d0-a56f-639d7d9d8843 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:09.070450 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-eb7d10e3-1d69-46d0-a56f-639d7d9d8843 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/1b4d9d7f-8b12-4bfa-83a0-e55a8422d754" status: 200 len: 1365 microversion: 2.1 time: 0.145909 Jul 28 18:21:09.071020 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 410/818] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:21:08 2022] GET /compute/v2.1/servers/1b4d9d7f-8b12-4bfa-83a0-e55a8422d754 => generated 1365 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:21:09.742017 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-65f1bdbe-0f64-466f-a20d-36bd28bf6f7c tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:09.742539 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-65f1bdbe-0f64-466f-a20d-36bd28bf6f7c tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: cc02a9d1-d99e-4119-b12f-63effaab3d40] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:09.749264 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-65f1bdbe-0f64-466f-a20d-36bd28bf6f7c tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:09.749712 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-65f1bdbe-0f64-466f-a20d-36bd28bf6f7c tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:09.750474 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-65f1bdbe-0f64-466f-a20d-36bd28bf6f7c tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:09.750892 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-65f1bdbe-0f64-466f-a20d-36bd28bf6f7c tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:09.810936 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-65f1bdbe-0f64-466f-a20d-36bd28bf6f7c tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:09.818815 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-65f1bdbe-0f64-466f-a20d-36bd28bf6f7c tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/cc02a9d1-d99e-4119-b12f-63effaab3d40" status: 200 len: 1191 microversion: 2.1 time: 0.080762 Jul 28 18:21:09.819385 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 409/819] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:21:09 2022] GET /compute/v2.1/servers/cc02a9d1-d99e-4119-b12f-63effaab3d40 => generated 1191 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:21:09.929001 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-68addf92-d683-462b-adef-82502d34299e tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:09.929630 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-68addf92-d683-462b-adef-82502d34299e tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:09.936147 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-68addf92-d683-462b-adef-82502d34299e tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:09.936598 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-68addf92-d683-462b-adef-82502d34299e tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:09.937394 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-68addf92-d683-462b-adef-82502d34299e tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:09.937836 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-68addf92-d683-462b-adef-82502d34299e tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:10.071888 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-68addf92-d683-462b-adef-82502d34299e tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba025a383c433b900a3f4ae64959b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf347b1959b247bcbe003ac3662cb239', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:10.079273 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-68addf92-d683-462b-adef-82502d34299e tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213" status: 200 len: 1568 microversion: 2.1 time: 0.154177 Jul 28 18:21:10.079873 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 411/820] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:21:09 2022] GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:21:10.091309 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-fb386d91-c3dd-440b-b2eb-c30b0288908d tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:10.092444 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-fb386d91-c3dd-440b-b2eb-c30b0288908d tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: 1b4d9d7f-8b12-4bfa-83a0-e55a8422d754] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:10.098624 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fb386d91-c3dd-440b-b2eb-c30b0288908d tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:10.099079 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fb386d91-c3dd-440b-b2eb-c30b0288908d tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:10.099837 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fb386d91-c3dd-440b-b2eb-c30b0288908d tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:10.100280 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fb386d91-c3dd-440b-b2eb-c30b0288908d tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:10.241282 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-fb386d91-c3dd-440b-b2eb-c30b0288908d tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:10.253079 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-fb386d91-c3dd-440b-b2eb-c30b0288908d tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/1b4d9d7f-8b12-4bfa-83a0-e55a8422d754" status: 200 len: 1555 microversion: 2.1 time: 0.163272 Jul 28 18:21:10.253079 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 410/821] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:21:10 2022] GET /compute/v2.1/servers/1b4d9d7f-8b12-4bfa-83a0-e55a8422d754 => generated 1555 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:21:10.286405 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-d9bc0990-d5fa-4a96-b751-fd72069802bf tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:10.286833 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-d9bc0990-d5fa-4a96-b751-fd72069802bf tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: 1b4d9d7f-8b12-4bfa-83a0-e55a8422d754] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:10.293390 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d9bc0990-d5fa-4a96-b751-fd72069802bf tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:10.293852 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d9bc0990-d5fa-4a96-b751-fd72069802bf tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:10.295718 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d9bc0990-d5fa-4a96-b751-fd72069802bf tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:10.296177 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d9bc0990-d5fa-4a96-b751-fd72069802bf tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:10.385967 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-d9bc0990-d5fa-4a96-b751-fd72069802bf tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/1b4d9d7f-8b12-4bfa-83a0-e55a8422d754/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.111284 Jul 28 18:21:10.387193 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 412/822] 10.222.0.86 () {58 vars in 1275 bytes} [Thu Jul 28 18:21:10 2022] GET /compute/v2.1/servers/1b4d9d7f-8b12-4bfa-83a0-e55a8422d754/os-interface => generated 284 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:21:10.840015 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3bcee5ed-85b6-4ef4-9748-5b15a434d763 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:10.840633 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3bcee5ed-85b6-4ef4-9748-5b15a434d763 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: cc02a9d1-d99e-4119-b12f-63effaab3d40] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:10.846619 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3bcee5ed-85b6-4ef4-9748-5b15a434d763 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:10.847074 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3bcee5ed-85b6-4ef4-9748-5b15a434d763 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:10.847844 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3bcee5ed-85b6-4ef4-9748-5b15a434d763 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:10.848282 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3bcee5ed-85b6-4ef4-9748-5b15a434d763 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:10.910162 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-3bcee5ed-85b6-4ef4-9748-5b15a434d763 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:10.917794 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-3bcee5ed-85b6-4ef4-9748-5b15a434d763 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/cc02a9d1-d99e-4119-b12f-63effaab3d40" status: 200 len: 1209 microversion: 2.1 time: 0.082068 Jul 28 18:21:10.918365 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 411/823] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:21:10 2022] GET /compute/v2.1/servers/cc02a9d1-d99e-4119-b12f-63effaab3d40 => generated 1209 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:21:11.101676 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-d1988927-e999-4824-b3a0-5566bee00e7b tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:11.102287 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-d1988927-e999-4824-b3a0-5566bee00e7b tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:11.108835 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d1988927-e999-4824-b3a0-5566bee00e7b tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:11.109319 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d1988927-e999-4824-b3a0-5566bee00e7b tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:11.110152 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d1988927-e999-4824-b3a0-5566bee00e7b tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:11.110589 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d1988927-e999-4824-b3a0-5566bee00e7b tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:11.250626 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-d1988927-e999-4824-b3a0-5566bee00e7b tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba025a383c433b900a3f4ae64959b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf347b1959b247bcbe003ac3662cb239', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:11.256880 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:21:11.262308 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-d1988927-e999-4824-b3a0-5566bee00e7b tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213" status: 200 len: 1568 microversion: 2.1 time: 0.165032 Jul 28 18:21:11.262886 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 413/824] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:21:11 2022] GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:21:11.940847 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d309ad38-366e-4ac4-a183-d69e817a7d14 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:11.941444 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-d309ad38-366e-4ac4-a183-d69e817a7d14 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: cc02a9d1-d99e-4119-b12f-63effaab3d40] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:11.948195 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d309ad38-366e-4ac4-a183-d69e817a7d14 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:11.948657 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d309ad38-366e-4ac4-a183-d69e817a7d14 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:11.949726 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d309ad38-366e-4ac4-a183-d69e817a7d14 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:11.950593 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d309ad38-366e-4ac4-a183-d69e817a7d14 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:12.080184 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [req-bfab8747-5a20-4ac8-b986-d8b4cfcd4ad7 req-de72fc4c-a759-419e-bf39-d17bd41c2c4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b4d9d7f-8b12-4bfa-83a0-e55a8422d754", "tag": "61aa0381-f0f3-4341-9fdf-0aba5beb4f6a"}]} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:21:12.090256 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-bfab8747-5a20-4ac8-b986-d8b4cfcd4ad7 req-de72fc4c-a759-419e-bf39-d17bd41c2c4c service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:12.090976 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-bfab8747-5a20-4ac8-b986-d8b4cfcd4ad7 req-de72fc4c-a759-419e-bf39-d17bd41c2c4c service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:12.099459 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-d309ad38-366e-4ac4-a183-d69e817a7d14 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:12.110370 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-d309ad38-366e-4ac4-a183-d69e817a7d14 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/cc02a9d1-d99e-4119-b12f-63effaab3d40" status: 200 len: 1264 microversion: 2.1 time: 0.173239 Jul 28 18:21:12.124811 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 412/825] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:21:11 2022] GET /compute/v2.1/servers/cc02a9d1-d99e-4119-b12f-63effaab3d40 => generated 1264 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:21:12.271059 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.compute.server_external_events [req-bfab8747-5a20-4ac8-b986-d8b4cfcd4ad7 req-de72fc4c-a759-419e-bf39-d17bd41c2c4c service nova] Creating event network-changed:61aa0381-f0f3-4341-9fdf-0aba5beb4f6a for instance 1b4d9d7f-8b12-4bfa-83a0-e55a8422d754 on hv-cinder-84617 Jul 28 18:21:12.276131 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [req-bfab8747-5a20-4ac8-b986-d8b4cfcd4ad7 req-de72fc4c-a759-419e-bf39-d17bd41c2c4c service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.200524 Jul 28 18:21:12.276793 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 414/826] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 18:21:12.283726 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-e0e96a1e-1173-4bae-8d90-ae336cb4b026 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:12.284346 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-e0e96a1e-1173-4bae-8d90-ae336cb4b026 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:12.290674 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e0e96a1e-1173-4bae-8d90-ae336cb4b026 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:12.291135 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e0e96a1e-1173-4bae-8d90-ae336cb4b026 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:12.291942 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e0e96a1e-1173-4bae-8d90-ae336cb4b026 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:12.292388 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e0e96a1e-1173-4bae-8d90-ae336cb4b026 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:12.524365 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-e0e96a1e-1173-4bae-8d90-ae336cb4b026 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba025a383c433b900a3f4ae64959b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf347b1959b247bcbe003ac3662cb239', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:12.533706 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-e0e96a1e-1173-4bae-8d90-ae336cb4b026 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213" status: 200 len: 1568 microversion: 2.1 time: 0.253883 Jul 28 18:21:12.534918 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 413/827] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:21:12 2022] GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213 => generated 1568 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:21:13.132406 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-051e0511-7f01-48b2-9def-6c4bda04fc45 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:13.134291 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-051e0511-7f01-48b2-9def-6c4bda04fc45 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: cc02a9d1-d99e-4119-b12f-63effaab3d40] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:13.142849 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-051e0511-7f01-48b2-9def-6c4bda04fc45 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:13.143862 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-051e0511-7f01-48b2-9def-6c4bda04fc45 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:13.144779 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-051e0511-7f01-48b2-9def-6c4bda04fc45 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:13.145761 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-051e0511-7f01-48b2-9def-6c4bda04fc45 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:13.365440 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-051e0511-7f01-48b2-9def-6c4bda04fc45 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:13.374002 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-051e0511-7f01-48b2-9def-6c4bda04fc45 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/cc02a9d1-d99e-4119-b12f-63effaab3d40" status: 200 len: 1264 microversion: 2.1 time: 0.245962 Jul 28 18:21:13.374715 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 415/828] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:21:13 2022] GET /compute/v2.1/servers/cc02a9d1-d99e-4119-b12f-63effaab3d40 => generated 1264 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:21:13.555752 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-85b8a3a0-eca8-4209-bd33-ce97efae7ddf tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:13.556376 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-85b8a3a0-eca8-4209-bd33-ce97efae7ddf tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:13.563547 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-85b8a3a0-eca8-4209-bd33-ce97efae7ddf tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:13.563997 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-85b8a3a0-eca8-4209-bd33-ce97efae7ddf tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:13.564769 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-85b8a3a0-eca8-4209-bd33-ce97efae7ddf tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:13.565248 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-85b8a3a0-eca8-4209-bd33-ce97efae7ddf tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:13.697048 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-85b8a3a0-eca8-4209-bd33-ce97efae7ddf tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba025a383c433b900a3f4ae64959b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf347b1959b247bcbe003ac3662cb239', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:13.705083 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-85b8a3a0-eca8-4209-bd33-ce97efae7ddf tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213" status: 200 len: 1568 microversion: 2.1 time: 0.153354 Jul 28 18:21:13.705754 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 414/829] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:21:13 2022] GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:21:14.290485 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [req-2e86d234-ea37-41e4-8ef1-73ecf17cadd6 req-8f4cdd45-46a0-44cb-b37b-6ca7aebfb230 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc02a9d1-d99e-4119-b12f-63effaab3d40", "tag": "2bf36b8c-9461-4402-a7fa-dd60e55d9326"}]} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:21:14.300174 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-2e86d234-ea37-41e4-8ef1-73ecf17cadd6 req-8f4cdd45-46a0-44cb-b37b-6ca7aebfb230 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:14.300619 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-2e86d234-ea37-41e4-8ef1-73ecf17cadd6 req-8f4cdd45-46a0-44cb-b37b-6ca7aebfb230 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:14.311172 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.compute.server_external_events [req-2e86d234-ea37-41e4-8ef1-73ecf17cadd6 req-8f4cdd45-46a0-44cb-b37b-6ca7aebfb230 service nova] Creating event network-changed:2bf36b8c-9461-4402-a7fa-dd60e55d9326 for instance cc02a9d1-d99e-4119-b12f-63effaab3d40 on hv-cinder-84617 Jul 28 18:21:14.316185 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [req-2e86d234-ea37-41e4-8ef1-73ecf17cadd6 req-8f4cdd45-46a0-44cb-b37b-6ca7aebfb230 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029304 Jul 28 18:21:14.316765 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 416/830] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:21:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:21:14.395173 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-35e46907-aca5-4321-825e-732023fc993d tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:14.395818 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-35e46907-aca5-4321-825e-732023fc993d tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: cc02a9d1-d99e-4119-b12f-63effaab3d40] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:14.401912 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-35e46907-aca5-4321-825e-732023fc993d tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:14.402358 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-35e46907-aca5-4321-825e-732023fc993d tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:14.403116 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-35e46907-aca5-4321-825e-732023fc993d tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:14.403556 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-35e46907-aca5-4321-825e-732023fc993d tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:14.539571 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-35e46907-aca5-4321-825e-732023fc993d tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:14.547220 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-35e46907-aca5-4321-825e-732023fc993d tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/cc02a9d1-d99e-4119-b12f-63effaab3d40" status: 200 len: 1264 microversion: 2.1 time: 0.155882 Jul 28 18:21:14.547789 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 415/831] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:21:14 2022] GET /compute/v2.1/servers/cc02a9d1-d99e-4119-b12f-63effaab3d40 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:21:14.727962 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-1308b008-341d-496f-b79c-0ae49b0be01b tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:14.728706 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-1308b008-341d-496f-b79c-0ae49b0be01b tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:14.735367 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-1308b008-341d-496f-b79c-0ae49b0be01b tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:14.735861 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-1308b008-341d-496f-b79c-0ae49b0be01b tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:14.736624 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-1308b008-341d-496f-b79c-0ae49b0be01b tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:14.737092 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-1308b008-341d-496f-b79c-0ae49b0be01b tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:14.868271 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-1308b008-341d-496f-b79c-0ae49b0be01b tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba025a383c433b900a3f4ae64959b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf347b1959b247bcbe003ac3662cb239', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:14.876442 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-1308b008-341d-496f-b79c-0ae49b0be01b tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213" status: 200 len: 1568 microversion: 2.1 time: 0.152718 Jul 28 18:21:14.877021 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 417/832] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:21:14 2022] GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:21:15.567788 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-6446a384-778c-4374-aa19-d13f40c01166 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:15.568389 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-6446a384-778c-4374-aa19-d13f40c01166 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: cc02a9d1-d99e-4119-b12f-63effaab3d40] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:15.574890 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6446a384-778c-4374-aa19-d13f40c01166 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:15.575342 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6446a384-778c-4374-aa19-d13f40c01166 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:15.576591 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6446a384-778c-4374-aa19-d13f40c01166 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:15.577064 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6446a384-778c-4374-aa19-d13f40c01166 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:15.707767 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-6446a384-778c-4374-aa19-d13f40c01166 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:15.715464 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-6446a384-778c-4374-aa19-d13f40c01166 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/cc02a9d1-d99e-4119-b12f-63effaab3d40" status: 200 len: 1264 microversion: 2.1 time: 0.151557 Jul 28 18:21:15.716027 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 416/833] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:21:15 2022] GET /compute/v2.1/servers/cc02a9d1-d99e-4119-b12f-63effaab3d40 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:21:15.897308 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-9192a0ca-4b62-4000-96fc-02ab594fb0ad tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:15.897918 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-9192a0ca-4b62-4000-96fc-02ab594fb0ad tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:15.904340 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-9192a0ca-4b62-4000-96fc-02ab594fb0ad tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:15.904733 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-9192a0ca-4b62-4000-96fc-02ab594fb0ad tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:15.905536 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-9192a0ca-4b62-4000-96fc-02ab594fb0ad tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:15.905982 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-9192a0ca-4b62-4000-96fc-02ab594fb0ad tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:16.284100 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-9192a0ca-4b62-4000-96fc-02ab594fb0ad tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba025a383c433b900a3f4ae64959b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf347b1959b247bcbe003ac3662cb239', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:16.291558 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-9192a0ca-4b62-4000-96fc-02ab594fb0ad tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213" status: 200 len: 1568 microversion: 2.1 time: 0.398103 Jul 28 18:21:16.292114 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 418/834] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:21:15 2022] GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213 => generated 1568 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:21:16.737257 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ea023552-aa3d-4120-9636-8ffb497a67f0 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:16.737890 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ea023552-aa3d-4120-9636-8ffb497a67f0 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: cc02a9d1-d99e-4119-b12f-63effaab3d40] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:16.744351 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ea023552-aa3d-4120-9636-8ffb497a67f0 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:16.744794 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ea023552-aa3d-4120-9636-8ffb497a67f0 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:16.745582 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ea023552-aa3d-4120-9636-8ffb497a67f0 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:16.746053 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ea023552-aa3d-4120-9636-8ffb497a67f0 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:16.877048 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ea023552-aa3d-4120-9636-8ffb497a67f0 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:16.884439 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ea023552-aa3d-4120-9636-8ffb497a67f0 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/cc02a9d1-d99e-4119-b12f-63effaab3d40" status: 200 len: 1264 microversion: 2.1 time: 0.151818 Jul 28 18:21:16.885013 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 417/835] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:21:16 2022] GET /compute/v2.1/servers/cc02a9d1-d99e-4119-b12f-63effaab3d40 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:21:17.313344 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-668c2f46-a3e2-4a81-a9d1-62081a6471fe tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:17.313948 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-668c2f46-a3e2-4a81-a9d1-62081a6471fe tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:17.320372 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-668c2f46-a3e2-4a81-a9d1-62081a6471fe tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:17.320819 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-668c2f46-a3e2-4a81-a9d1-62081a6471fe tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:17.321603 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-668c2f46-a3e2-4a81-a9d1-62081a6471fe tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:17.322037 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-668c2f46-a3e2-4a81-a9d1-62081a6471fe tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:17.453658 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-668c2f46-a3e2-4a81-a9d1-62081a6471fe tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba025a383c433b900a3f4ae64959b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf347b1959b247bcbe003ac3662cb239', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:17.461133 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-668c2f46-a3e2-4a81-a9d1-62081a6471fe tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213" status: 200 len: 1568 microversion: 2.1 time: 0.152474 Jul 28 18:21:17.461696 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 419/836] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:21:17 2022] GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:21:17.906474 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-fd901427-a705-41c4-b36e-35ae34cc9ca9 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:17.907532 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-fd901427-a705-41c4-b36e-35ae34cc9ca9 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: cc02a9d1-d99e-4119-b12f-63effaab3d40] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:17.909675 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell0:SELECT=2 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:21:17.910376 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell0:SELECT=8 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:21:17.911502 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:21:17.916462 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fd901427-a705-41c4-b36e-35ae34cc9ca9 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:17.916952 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fd901427-a705-41c4-b36e-35ae34cc9ca9 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:17.921612 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fd901427-a705-41c4-b36e-35ae34cc9ca9 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:17.921612 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fd901427-a705-41c4-b36e-35ae34cc9ca9 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:18.047385 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-fd901427-a705-41c4-b36e-35ae34cc9ca9 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:18.049708 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:21:18.055412 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-fd901427-a705-41c4-b36e-35ae34cc9ca9 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/cc02a9d1-d99e-4119-b12f-63effaab3d40" status: 200 len: 1264 microversion: 2.1 time: 0.154164 Jul 28 18:21:18.055979 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 418/837] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:21:17 2022] GET /compute/v2.1/servers/cc02a9d1-d99e-4119-b12f-63effaab3d40 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:21:18.483181 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-827742b5-eaaa-455a-9474-b0515e32e7aa tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:18.483886 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-827742b5-eaaa-455a-9474-b0515e32e7aa tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:18.490406 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-827742b5-eaaa-455a-9474-b0515e32e7aa tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:18.490857 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-827742b5-eaaa-455a-9474-b0515e32e7aa tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:18.491622 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-827742b5-eaaa-455a-9474-b0515e32e7aa tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:18.492061 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-827742b5-eaaa-455a-9474-b0515e32e7aa tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:18.707527 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-827742b5-eaaa-455a-9474-b0515e32e7aa tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba025a383c433b900a3f4ae64959b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf347b1959b247bcbe003ac3662cb239', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:18.715290 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-827742b5-eaaa-455a-9474-b0515e32e7aa tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213" status: 200 len: 1568 microversion: 2.1 time: 0.236586 Jul 28 18:21:18.715849 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 420/838] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:21:18 2022] GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213 => generated 1568 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:21:19.076328 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-77d14afa-0c70-4666-ae35-05721b74308b tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:19.076999 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-77d14afa-0c70-4666-ae35-05721b74308b tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: cc02a9d1-d99e-4119-b12f-63effaab3d40] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:19.084661 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-77d14afa-0c70-4666-ae35-05721b74308b tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:19.085277 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-77d14afa-0c70-4666-ae35-05721b74308b tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:19.086055 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-77d14afa-0c70-4666-ae35-05721b74308b tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:19.086498 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-77d14afa-0c70-4666-ae35-05721b74308b tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:19.227698 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-77d14afa-0c70-4666-ae35-05721b74308b tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:19.235347 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-77d14afa-0c70-4666-ae35-05721b74308b tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/cc02a9d1-d99e-4119-b12f-63effaab3d40" status: 200 len: 1264 microversion: 2.1 time: 0.163462 Jul 28 18:21:19.236136 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 419/839] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:21:19 2022] GET /compute/v2.1/servers/cc02a9d1-d99e-4119-b12f-63effaab3d40 => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:21:19.736950 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-89924d07-f8f1-4fb4-af8e-901dfc1f74b2 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:19.737628 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-89924d07-f8f1-4fb4-af8e-901dfc1f74b2 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:19.740052 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=4 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:21:19.744842 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-89924d07-f8f1-4fb4-af8e-901dfc1f74b2 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:19.745330 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-89924d07-f8f1-4fb4-af8e-901dfc1f74b2 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:19.746101 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-89924d07-f8f1-4fb4-af8e-901dfc1f74b2 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:19.746539 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-89924d07-f8f1-4fb4-af8e-901dfc1f74b2 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:19.883499 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-89924d07-f8f1-4fb4-af8e-901dfc1f74b2 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba025a383c433b900a3f4ae64959b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf347b1959b247bcbe003ac3662cb239', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:19.891717 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-89924d07-f8f1-4fb4-af8e-901dfc1f74b2 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213" status: 200 len: 1568 microversion: 2.1 time: 0.158652 Jul 28 18:21:19.894301 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 421/840] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:21:19 2022] GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:21:20.256363 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-9ee266f4-8859-4d98-a6c3-a76fb9f573c2 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:20.257032 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-9ee266f4-8859-4d98-a6c3-a76fb9f573c2 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: cc02a9d1-d99e-4119-b12f-63effaab3d40] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:20.263678 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9ee266f4-8859-4d98-a6c3-a76fb9f573c2 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:20.269745 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9ee266f4-8859-4d98-a6c3-a76fb9f573c2 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:20.269745 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9ee266f4-8859-4d98-a6c3-a76fb9f573c2 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:20.269745 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9ee266f4-8859-4d98-a6c3-a76fb9f573c2 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:20.404038 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-9ee266f4-8859-4d98-a6c3-a76fb9f573c2 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:20.412517 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-9ee266f4-8859-4d98-a6c3-a76fb9f573c2 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/cc02a9d1-d99e-4119-b12f-63effaab3d40" status: 200 len: 1264 microversion: 2.1 time: 0.159990 Jul 28 18:21:20.413126 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 420/841] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:21:20 2022] GET /compute/v2.1/servers/cc02a9d1-d99e-4119-b12f-63effaab3d40 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:21:20.913079 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-35383f47-9597-442d-bbad-169b96f38740 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:20.913682 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-35383f47-9597-442d-bbad-169b96f38740 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:20.920152 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-35383f47-9597-442d-bbad-169b96f38740 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:20.920597 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-35383f47-9597-442d-bbad-169b96f38740 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:20.921375 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-35383f47-9597-442d-bbad-169b96f38740 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:20.921808 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-35383f47-9597-442d-bbad-169b96f38740 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:21.052805 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-35383f47-9597-442d-bbad-169b96f38740 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba025a383c433b900a3f4ae64959b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf347b1959b247bcbe003ac3662cb239', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:21.060877 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-35383f47-9597-442d-bbad-169b96f38740 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213" status: 200 len: 1568 microversion: 2.1 time: 0.151261 Jul 28 18:21:21.061468 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 422/842] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:21:20 2022] GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:21:21.433889 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5ede3cee-18cf-4e20-8ba5-90d45c691238 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:21.434508 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-5ede3cee-18cf-4e20-8ba5-90d45c691238 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: cc02a9d1-d99e-4119-b12f-63effaab3d40] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:21.441573 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5ede3cee-18cf-4e20-8ba5-90d45c691238 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:21.442031 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5ede3cee-18cf-4e20-8ba5-90d45c691238 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:21.442799 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5ede3cee-18cf-4e20-8ba5-90d45c691238 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:21.443243 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5ede3cee-18cf-4e20-8ba5-90d45c691238 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:21.577335 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-5ede3cee-18cf-4e20-8ba5-90d45c691238 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:21.584829 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-5ede3cee-18cf-4e20-8ba5-90d45c691238 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/cc02a9d1-d99e-4119-b12f-63effaab3d40" status: 200 len: 1264 microversion: 2.1 time: 0.154824 Jul 28 18:21:21.585435 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 421/843] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:21:21 2022] GET /compute/v2.1/servers/cc02a9d1-d99e-4119-b12f-63effaab3d40 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:21:22.081545 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-856a8c25-c36e-4e6f-8c2c-45d3bce473b8 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:22.082161 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-856a8c25-c36e-4e6f-8c2c-45d3bce473b8 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:22.088915 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-856a8c25-c36e-4e6f-8c2c-45d3bce473b8 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:22.089314 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-856a8c25-c36e-4e6f-8c2c-45d3bce473b8 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:22.090116 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-856a8c25-c36e-4e6f-8c2c-45d3bce473b8 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:22.090562 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-856a8c25-c36e-4e6f-8c2c-45d3bce473b8 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:22.226395 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-856a8c25-c36e-4e6f-8c2c-45d3bce473b8 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba025a383c433b900a3f4ae64959b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf347b1959b247bcbe003ac3662cb239', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:22.234029 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-856a8c25-c36e-4e6f-8c2c-45d3bce473b8 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213" status: 200 len: 1568 microversion: 2.1 time: 0.156531 Jul 28 18:21:22.234592 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 423/844] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:21:22 2022] GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:21:22.611602 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-2cbf96a1-82a5-4b59-b1fb-71496ff85a8c tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:22.612208 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-2cbf96a1-82a5-4b59-b1fb-71496ff85a8c tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: cc02a9d1-d99e-4119-b12f-63effaab3d40] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:22.618733 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2cbf96a1-82a5-4b59-b1fb-71496ff85a8c tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:22.619184 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2cbf96a1-82a5-4b59-b1fb-71496ff85a8c tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:22.619989 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2cbf96a1-82a5-4b59-b1fb-71496ff85a8c tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:22.620427 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2cbf96a1-82a5-4b59-b1fb-71496ff85a8c tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:22.769502 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-2cbf96a1-82a5-4b59-b1fb-71496ff85a8c tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:22.777177 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-2cbf96a1-82a5-4b59-b1fb-71496ff85a8c tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/cc02a9d1-d99e-4119-b12f-63effaab3d40" status: 200 len: 1264 microversion: 2.1 time: 0.169293 Jul 28 18:21:22.777744 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 422/845] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:21:22 2022] GET /compute/v2.1/servers/cc02a9d1-d99e-4119-b12f-63effaab3d40 => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:21:23.255835 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-7edbd894-4879-4ae8-abde-b21fc6d9ac18 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:23.256586 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-7edbd894-4879-4ae8-abde-b21fc6d9ac18 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:23.263256 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-7edbd894-4879-4ae8-abde-b21fc6d9ac18 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:23.263734 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-7edbd894-4879-4ae8-abde-b21fc6d9ac18 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:23.264494 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-7edbd894-4879-4ae8-abde-b21fc6d9ac18 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:23.264931 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-7edbd894-4879-4ae8-abde-b21fc6d9ac18 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:23.397667 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-7edbd894-4879-4ae8-abde-b21fc6d9ac18 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba025a383c433b900a3f4ae64959b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf347b1959b247bcbe003ac3662cb239', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:23.405887 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-7edbd894-4879-4ae8-abde-b21fc6d9ac18 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213" status: 200 len: 1569 microversion: 2.1 time: 0.154179 Jul 28 18:21:23.406448 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 424/846] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:21:23 2022] GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:21:23.426952 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-6aa21c2b-e170-4847-9eeb-cf83022a6aea tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:21:23.427566 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-6aa21c2b-e170-4847-9eeb-cf83022a6aea tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:23.434025 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6aa21c2b-e170-4847-9eeb-cf83022a6aea tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:23.434614 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6aa21c2b-e170-4847-9eeb-cf83022a6aea tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:23.435375 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6aa21c2b-e170-4847-9eeb-cf83022a6aea tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:23.435811 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6aa21c2b-e170-4847-9eeb-cf83022a6aea tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:23.463971 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-6aa21c2b-e170-4847-9eeb-cf83022a6aea tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118453) unshelve /opt/stack/nova/nova/compute/api.py:4532}} Jul 28 18:21:23.755143 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-6aa21c2b-e170-4847-9eeb-cf83022a6aea tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "POST /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213/action" status: 202 len: 0 microversion: 2.1 time: 0.332044 Jul 28 18:21:23.755796 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 423/847] 10.222.0.86 () {60 vars in 1278 bytes} [Thu Jul 28 18:21:23 2022] POST /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213/action => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 18:21:23.764369 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-6e192e39-9c2b-4bc6-921c-84a24ff33ea5 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:23.765348 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-6e192e39-9c2b-4bc6-921c-84a24ff33ea5 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:23.771553 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-6e192e39-9c2b-4bc6-921c-84a24ff33ea5 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:23.772012 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-6e192e39-9c2b-4bc6-921c-84a24ff33ea5 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:23.772780 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-6e192e39-9c2b-4bc6-921c-84a24ff33ea5 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:23.773246 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-6e192e39-9c2b-4bc6-921c-84a24ff33ea5 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:23.797352 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-aca23657-42a4-483a-9388-467c4479733a tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:23.797968 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-aca23657-42a4-483a-9388-467c4479733a tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: cc02a9d1-d99e-4119-b12f-63effaab3d40] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:23.804413 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-aca23657-42a4-483a-9388-467c4479733a tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:23.804881 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-aca23657-42a4-483a-9388-467c4479733a tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:23.805738 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-aca23657-42a4-483a-9388-467c4479733a tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:23.806183 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-aca23657-42a4-483a-9388-467c4479733a tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:23.988270 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-6e192e39-9c2b-4bc6-921c-84a24ff33ea5 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba025a383c433b900a3f4ae64959b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf347b1959b247bcbe003ac3662cb239', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:23.992808 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-aca23657-42a4-483a-9388-467c4479733a tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:23.996176 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-6e192e39-9c2b-4bc6-921c-84a24ff33ea5 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213" status: 200 len: 1517 microversion: 2.1 time: 0.236094 Jul 28 18:21:23.996907 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 425/848] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:21:23 2022] GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213 => generated 1517 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:21:24.014361 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-aca23657-42a4-483a-9388-467c4479733a tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/cc02a9d1-d99e-4119-b12f-63effaab3d40" status: 200 len: 1264 microversion: 2.1 time: 0.207209 Jul 28 18:21:24.014361 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 424/849] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:21:23 2022] GET /compute/v2.1/servers/cc02a9d1-d99e-4119-b12f-63effaab3d40 => generated 1264 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:21:24.431896 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-7f52ad70-d9ab-42fd-acea-49e76bbf42c9 req-3e70102c-7e70-4cd0-8888-bb007b1e7c14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb0a115f-17bf-4501-af27-0802f70ac213", "name": "network-vif-unplugged", "status": "completed", "tag": "5415e2f4-0f86-4921-bdc7-f0bf38bcd3e3"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:21:24.442069 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-7f52ad70-d9ab-42fd-acea-49e76bbf42c9 req-3e70102c-7e70-4cd0-8888-bb007b1e7c14 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:24.442751 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-7f52ad70-d9ab-42fd-acea-49e76bbf42c9 req-3e70102c-7e70-4cd0-8888-bb007b1e7c14 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:24.455090 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.compute.server_external_events [req-7f52ad70-d9ab-42fd-acea-49e76bbf42c9 req-3e70102c-7e70-4cd0-8888-bb007b1e7c14 service nova] Unable to find a host for instance eb0a115f-17bf-4501-af27-0802f70ac213. Dropping event network-vif-unplugged {{(pid=118453) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 28 18:21:24.455964 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-7f52ad70-d9ab-42fd-acea-49e76bbf42c9 req-3e70102c-7e70-4cd0-8888-bb007b1e7c14 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028109 Jul 28 18:21:24.456555 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 425/850] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:21:24 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 28 18:21:25.017728 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-55c53df5-0d95-49d4-ba16-6d808a8b9350 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:25.018343 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-55c53df5-0d95-49d4-ba16-6d808a8b9350 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:25.020954 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-c9b37de7-904a-49e1-9f3d-f52ac9cc260d tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:25.021573 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-c9b37de7-904a-49e1-9f3d-f52ac9cc260d tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: cc02a9d1-d99e-4119-b12f-63effaab3d40] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:25.026308 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-55c53df5-0d95-49d4-ba16-6d808a8b9350 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:25.030305 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-55c53df5-0d95-49d4-ba16-6d808a8b9350 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:25.030305 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-55c53df5-0d95-49d4-ba16-6d808a8b9350 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:25.030305 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-55c53df5-0d95-49d4-ba16-6d808a8b9350 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:25.030600 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c9b37de7-904a-49e1-9f3d-f52ac9cc260d tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:25.030600 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c9b37de7-904a-49e1-9f3d-f52ac9cc260d tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:25.030600 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c9b37de7-904a-49e1-9f3d-f52ac9cc260d tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:25.030600 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c9b37de7-904a-49e1-9f3d-f52ac9cc260d tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:25.235678 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-55c53df5-0d95-49d4-ba16-6d808a8b9350 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba025a383c433b900a3f4ae64959b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf347b1959b247bcbe003ac3662cb239', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:25.239064 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-c9b37de7-904a-49e1-9f3d-f52ac9cc260d tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:25.250160 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-c9b37de7-904a-49e1-9f3d-f52ac9cc260d tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/cc02a9d1-d99e-4119-b12f-63effaab3d40" status: 200 len: 1264 microversion: 2.1 time: 0.232895 Jul 28 18:21:25.252365 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-55c53df5-0d95-49d4-ba16-6d808a8b9350 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213" status: 200 len: 1519 microversion: 2.1 time: 0.238551 Jul 28 18:21:25.253318 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 426/851] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:21:25 2022] GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213 => generated 1519 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:21:25.265136 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 426/852] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:21:25 2022] GET /compute/v2.1/servers/cc02a9d1-d99e-4119-b12f-63effaab3d40 => generated 1264 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:21:26.271509 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-225536d0-437a-4281-8212-4c992a3ac94d tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:26.272140 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-225536d0-437a-4281-8212-4c992a3ac94d tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: cc02a9d1-d99e-4119-b12f-63effaab3d40] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:26.275519 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-a40a228b-e051-4694-bfff-86b5e9ba05a9 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:26.275519 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-a40a228b-e051-4694-bfff-86b5e9ba05a9 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:26.278936 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-225536d0-437a-4281-8212-4c992a3ac94d tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:26.280016 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-225536d0-437a-4281-8212-4c992a3ac94d tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:26.280867 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-225536d0-437a-4281-8212-4c992a3ac94d tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:26.281403 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-225536d0-437a-4281-8212-4c992a3ac94d tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:26.282731 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a40a228b-e051-4694-bfff-86b5e9ba05a9 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:26.283622 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a40a228b-e051-4694-bfff-86b5e9ba05a9 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:26.284569 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a40a228b-e051-4694-bfff-86b5e9ba05a9 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:26.285035 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a40a228b-e051-4694-bfff-86b5e9ba05a9 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:26.499641 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-225536d0-437a-4281-8212-4c992a3ac94d tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:26.503647 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-a40a228b-e051-4694-bfff-86b5e9ba05a9 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba025a383c433b900a3f4ae64959b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf347b1959b247bcbe003ac3662cb239', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:26.511311 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-225536d0-437a-4281-8212-4c992a3ac94d tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/cc02a9d1-d99e-4119-b12f-63effaab3d40" status: 200 len: 1264 microversion: 2.1 time: 0.243746 Jul 28 18:21:26.512140 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-a40a228b-e051-4694-bfff-86b5e9ba05a9 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213" status: 200 len: 1575 microversion: 2.1 time: 0.241300 Jul 28 18:21:26.512483 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 427/853] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:21:26 2022] GET /compute/v2.1/servers/cc02a9d1-d99e-4119-b12f-63effaab3d40 => generated 1264 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:21:26.518297 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-1a1a6d0f-ac1d-4977-bf02-a0bc3e0dd1ab req-04d74b59-e9d6-429e-8b45-ed9d582986e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc02a9d1-d99e-4119-b12f-63effaab3d40", "name": "network-vif-plugged", "status": "completed", "tag": "2bf36b8c-9461-4402-a7fa-dd60e55d9326"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:21:26.525599 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 427/854] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:21:26 2022] GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213 => generated 1575 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:21:26.528201 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-1a1a6d0f-ac1d-4977-bf02-a0bc3e0dd1ab req-04d74b59-e9d6-429e-8b45-ed9d582986e4 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:26.528763 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-1a1a6d0f-ac1d-4977-bf02-a0bc3e0dd1ab req-04d74b59-e9d6-429e-8b45-ed9d582986e4 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:26.540913 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-1a1a6d0f-ac1d-4977-bf02-a0bc3e0dd1ab req-04d74b59-e9d6-429e-8b45-ed9d582986e4 service nova] Creating event network-vif-plugged:2bf36b8c-9461-4402-a7fa-dd60e55d9326 for instance cc02a9d1-d99e-4119-b12f-63effaab3d40 on hv-cinder-84617 Jul 28 18:21:26.545983 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-1a1a6d0f-ac1d-4977-bf02-a0bc3e0dd1ab req-04d74b59-e9d6-429e-8b45-ed9d582986e4 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032107 Jul 28 18:21:26.546555 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 428/855] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:21:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:21:27.532510 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-f7524b02-198e-4874-a6df-4b3ecf5e9221 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:27.533145 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-f7524b02-198e-4874-a6df-4b3ecf5e9221 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: cc02a9d1-d99e-4119-b12f-63effaab3d40] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:27.539587 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f7524b02-198e-4874-a6df-4b3ecf5e9221 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:27.540029 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f7524b02-198e-4874-a6df-4b3ecf5e9221 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:27.540790 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f7524b02-198e-4874-a6df-4b3ecf5e9221 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:27.541244 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f7524b02-198e-4874-a6df-4b3ecf5e9221 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:27.548171 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0fa83c78-9df1-4d17-bc7d-b78eedec12ea tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:27.548907 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0fa83c78-9df1-4d17-bc7d-b78eedec12ea tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:27.554999 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0fa83c78-9df1-4d17-bc7d-b78eedec12ea tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:27.555454 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0fa83c78-9df1-4d17-bc7d-b78eedec12ea tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:27.556237 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0fa83c78-9df1-4d17-bc7d-b78eedec12ea tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:27.556792 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0fa83c78-9df1-4d17-bc7d-b78eedec12ea tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:27.743825 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-f7524b02-198e-4874-a6df-4b3ecf5e9221 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:27.747124 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-0fa83c78-9df1-4d17-bc7d-b78eedec12ea tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba025a383c433b900a3f4ae64959b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf347b1959b247bcbe003ac3662cb239', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:27.751978 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-f7524b02-198e-4874-a6df-4b3ecf5e9221 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/cc02a9d1-d99e-4119-b12f-63effaab3d40" status: 200 len: 1264 microversion: 2.1 time: 0.223403 Jul 28 18:21:27.752547 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 428/856] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:21:27 2022] GET /compute/v2.1/servers/cc02a9d1-d99e-4119-b12f-63effaab3d40 => generated 1264 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:21:27.755456 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0fa83c78-9df1-4d17-bc7d-b78eedec12ea tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213" status: 200 len: 1575 microversion: 2.1 time: 0.212508 Jul 28 18:21:27.756009 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 429/857] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:21:27 2022] GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213 => generated 1575 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:21:28.771823 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-988769c6-3d97-4527-8163-e3318accb546 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:28.772362 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-988769c6-3d97-4527-8163-e3318accb546 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: cc02a9d1-d99e-4119-b12f-63effaab3d40] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:28.779412 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-988769c6-3d97-4527-8163-e3318accb546 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:28.779862 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-988769c6-3d97-4527-8163-e3318accb546 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:28.781093 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-1ff61789-f752-4fcc-a32a-4991689cc020 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:28.781514 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-988769c6-3d97-4527-8163-e3318accb546 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:28.781616 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-988769c6-3d97-4527-8163-e3318accb546 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:28.781708 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-1ff61789-f752-4fcc-a32a-4991689cc020 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:28.788273 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1ff61789-f752-4fcc-a32a-4991689cc020 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:28.788717 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1ff61789-f752-4fcc-a32a-4991689cc020 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:28.789500 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1ff61789-f752-4fcc-a32a-4991689cc020 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:28.789938 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1ff61789-f752-4fcc-a32a-4991689cc020 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:28.980575 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-988769c6-3d97-4527-8163-e3318accb546 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:28.983767 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-1ff61789-f752-4fcc-a32a-4991689cc020 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba025a383c433b900a3f4ae64959b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf347b1959b247bcbe003ac3662cb239', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:28.988680 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-988769c6-3d97-4527-8163-e3318accb546 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/cc02a9d1-d99e-4119-b12f-63effaab3d40" status: 200 len: 1264 microversion: 2.1 time: 0.220833 Jul 28 18:21:28.989490 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 429/858] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:21:28 2022] GET /compute/v2.1/servers/cc02a9d1-d99e-4119-b12f-63effaab3d40 => generated 1264 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:21:28.991422 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-1ff61789-f752-4fcc-a32a-4991689cc020 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213" status: 200 len: 1575 microversion: 2.1 time: 0.214629 Jul 28 18:21:28.991980 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 430/859] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:21:28 2022] GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213 => generated 1575 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:21:30.008993 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-835f400e-49f7-4318-b0a2-ffa5120a9ad0 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:30.009635 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-835f400e-49f7-4318-b0a2-ffa5120a9ad0 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: cc02a9d1-d99e-4119-b12f-63effaab3d40] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:30.011544 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3e3745b4-1696-44ab-9baa-52fa4708ab3d tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:30.012151 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3e3745b4-1696-44ab-9baa-52fa4708ab3d tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:30.016204 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-835f400e-49f7-4318-b0a2-ffa5120a9ad0 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:30.016655 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-835f400e-49f7-4318-b0a2-ffa5120a9ad0 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:30.017453 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-835f400e-49f7-4318-b0a2-ffa5120a9ad0 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:30.017893 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-835f400e-49f7-4318-b0a2-ffa5120a9ad0 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:30.018452 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3e3745b4-1696-44ab-9baa-52fa4708ab3d tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:30.018903 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3e3745b4-1696-44ab-9baa-52fa4708ab3d tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:30.019782 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3e3745b4-1696-44ab-9baa-52fa4708ab3d tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:30.020214 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3e3745b4-1696-44ab-9baa-52fa4708ab3d tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:30.217319 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-835f400e-49f7-4318-b0a2-ffa5120a9ad0 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:30.221990 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-3e3745b4-1696-44ab-9baa-52fa4708ab3d tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba025a383c433b900a3f4ae64959b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf347b1959b247bcbe003ac3662cb239', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:30.226010 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-835f400e-49f7-4318-b0a2-ffa5120a9ad0 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/cc02a9d1-d99e-4119-b12f-63effaab3d40" status: 200 len: 1452 microversion: 2.1 time: 0.219940 Jul 28 18:21:30.226010 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 430/860] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:21:30 2022] GET /compute/v2.1/servers/cc02a9d1-d99e-4119-b12f-63effaab3d40 => generated 1452 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:21:30.230092 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-3e3745b4-1696-44ab-9baa-52fa4708ab3d tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213" status: 200 len: 1575 microversion: 2.1 time: 0.222444 Jul 28 18:21:30.230789 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 431/861] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:21:30 2022] GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213 => generated 1575 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:21:30.245333 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-ab3981a5-029c-4793-8ac7-7667600a60de tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:30.246020 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-ab3981a5-029c-4793-8ac7-7667600a60de tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: cc02a9d1-d99e-4119-b12f-63effaab3d40] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:30.251978 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ab3981a5-029c-4793-8ac7-7667600a60de tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:30.252431 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ab3981a5-029c-4793-8ac7-7667600a60de tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:30.253251 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ab3981a5-029c-4793-8ac7-7667600a60de tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:30.253687 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ab3981a5-029c-4793-8ac7-7667600a60de tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:30.392306 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-ab3981a5-029c-4793-8ac7-7667600a60de tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:30.395719 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell1:SELECT=100 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:21:30.400132 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-ab3981a5-029c-4793-8ac7-7667600a60de tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/cc02a9d1-d99e-4119-b12f-63effaab3d40" status: 200 len: 1452 microversion: 2.1 time: 0.158524 Jul 28 18:21:30.405305 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 431/862] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:21:30 2022] GET /compute/v2.1/servers/cc02a9d1-d99e-4119-b12f-63effaab3d40 => generated 1452 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:21:31.251948 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-1bf86668-e570-49f3-b126-76b07ecb88dc tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:31.252556 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-1bf86668-e570-49f3-b126-76b07ecb88dc tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:31.258986 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1bf86668-e570-49f3-b126-76b07ecb88dc tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:31.259428 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1bf86668-e570-49f3-b126-76b07ecb88dc tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:31.260185 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1bf86668-e570-49f3-b126-76b07ecb88dc tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:31.260619 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1bf86668-e570-49f3-b126-76b07ecb88dc tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:31.454451 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-1bf86668-e570-49f3-b126-76b07ecb88dc tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba025a383c433b900a3f4ae64959b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf347b1959b247bcbe003ac3662cb239', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:31.461913 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-1bf86668-e570-49f3-b126-76b07ecb88dc tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213" status: 200 len: 1575 microversion: 2.1 time: 0.213798 Jul 28 18:21:31.462485 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 432/863] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:21:31 2022] GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213 => generated 1575 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:21:32.485499 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-4bbaf226-5209-4205-bcc0-6a47cd6c3b7c tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:32.486116 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-4bbaf226-5209-4205-bcc0-6a47cd6c3b7c tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:32.494567 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-4bbaf226-5209-4205-bcc0-6a47cd6c3b7c tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:32.495019 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-4bbaf226-5209-4205-bcc0-6a47cd6c3b7c tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:32.495793 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-4bbaf226-5209-4205-bcc0-6a47cd6c3b7c tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:32.496232 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-4bbaf226-5209-4205-bcc0-6a47cd6c3b7c tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:32.627402 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-4bbaf226-5209-4205-bcc0-6a47cd6c3b7c tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba025a383c433b900a3f4ae64959b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf347b1959b247bcbe003ac3662cb239', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:32.635083 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-4bbaf226-5209-4205-bcc0-6a47cd6c3b7c tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213" status: 200 len: 1575 microversion: 2.1 time: 0.155247 Jul 28 18:21:32.635656 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 432/864] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:21:32 2022] GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:21:32.794031 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-b3a51272-5cb2-4540-a893-4f0f829ec435 req-a4dd875c-92a9-47e9-a0ae-46568eac4705 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc02a9d1-d99e-4119-b12f-63effaab3d40", "tag": "2bf36b8c-9461-4402-a7fa-dd60e55d9326"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:21:32.804599 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-b3a51272-5cb2-4540-a893-4f0f829ec435 req-a4dd875c-92a9-47e9-a0ae-46568eac4705 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:32.805067 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-b3a51272-5cb2-4540-a893-4f0f829ec435 req-a4dd875c-92a9-47e9-a0ae-46568eac4705 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:32.816536 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-b3a51272-5cb2-4540-a893-4f0f829ec435 req-a4dd875c-92a9-47e9-a0ae-46568eac4705 service nova] Creating event network-changed:2bf36b8c-9461-4402-a7fa-dd60e55d9326 for instance cc02a9d1-d99e-4119-b12f-63effaab3d40 on hv-cinder-84617 Jul 28 18:21:32.821453 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-b3a51272-5cb2-4540-a893-4f0f829ec435 req-a4dd875c-92a9-47e9-a0ae-46568eac4705 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031105 Jul 28 18:21:32.822284 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 433/865] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:21:33.657441 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-73bc0e0a-4186-43f7-a753-260f0ba8010c tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:33.658945 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-73bc0e0a-4186-43f7-a753-260f0ba8010c tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:33.665880 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-73bc0e0a-4186-43f7-a753-260f0ba8010c tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:33.666327 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-73bc0e0a-4186-43f7-a753-260f0ba8010c tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:33.667105 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-73bc0e0a-4186-43f7-a753-260f0ba8010c tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:33.667619 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-73bc0e0a-4186-43f7-a753-260f0ba8010c tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:33.802884 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-73bc0e0a-4186-43f7-a753-260f0ba8010c tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba025a383c433b900a3f4ae64959b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf347b1959b247bcbe003ac3662cb239', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:33.810966 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-73bc0e0a-4186-43f7-a753-260f0ba8010c tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213" status: 200 len: 1575 microversion: 2.1 time: 0.158026 Jul 28 18:21:33.811526 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 433/866] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:21:33 2022] GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:21:34.832781 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-596067a5-3b57-4da2-83a1-1df8655161dc tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:34.833510 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-596067a5-3b57-4da2-83a1-1df8655161dc tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:34.840078 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-596067a5-3b57-4da2-83a1-1df8655161dc tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:34.840534 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-596067a5-3b57-4da2-83a1-1df8655161dc tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:34.841838 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-596067a5-3b57-4da2-83a1-1df8655161dc tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:34.842282 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-596067a5-3b57-4da2-83a1-1df8655161dc tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:34.973876 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-596067a5-3b57-4da2-83a1-1df8655161dc tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba025a383c433b900a3f4ae64959b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf347b1959b247bcbe003ac3662cb239', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:34.981409 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-596067a5-3b57-4da2-83a1-1df8655161dc tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213" status: 200 len: 1575 microversion: 2.1 time: 0.153457 Jul 28 18:21:34.982345 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 434/867] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:21:34 2022] GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:21:36.006710 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-bf1aef03-3f58-47e5-84a3-c715794fc5c7 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:36.007217 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-bf1aef03-3f58-47e5-84a3-c715794fc5c7 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:36.013844 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-bf1aef03-3f58-47e5-84a3-c715794fc5c7 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:36.014321 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-bf1aef03-3f58-47e5-84a3-c715794fc5c7 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:36.015076 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-bf1aef03-3f58-47e5-84a3-c715794fc5c7 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:36.015511 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-bf1aef03-3f58-47e5-84a3-c715794fc5c7 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:36.150023 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-bf1aef03-3f58-47e5-84a3-c715794fc5c7 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba025a383c433b900a3f4ae64959b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf347b1959b247bcbe003ac3662cb239', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:36.158111 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-bf1aef03-3f58-47e5-84a3-c715794fc5c7 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213" status: 200 len: 1575 microversion: 2.1 time: 0.155466 Jul 28 18:21:36.159841 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 434/868] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:21:36 2022] GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:21:37.179686 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b9746a97-04b8-4777-89c0-7756dec38c4c tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:37.180301 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b9746a97-04b8-4777-89c0-7756dec38c4c tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:37.186973 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b9746a97-04b8-4777-89c0-7756dec38c4c tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:37.187428 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b9746a97-04b8-4777-89c0-7756dec38c4c tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:37.188205 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b9746a97-04b8-4777-89c0-7756dec38c4c tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:37.188650 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b9746a97-04b8-4777-89c0-7756dec38c4c tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:37.317095 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b9746a97-04b8-4777-89c0-7756dec38c4c tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba025a383c433b900a3f4ae64959b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf347b1959b247bcbe003ac3662cb239', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:37.324639 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b9746a97-04b8-4777-89c0-7756dec38c4c tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213" status: 200 len: 1575 microversion: 2.1 time: 0.148847 Jul 28 18:21:37.325236 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 435/869] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:21:37 2022] GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213 => generated 1575 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:21:38.346142 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-e451d5c5-20d0-44fc-931b-187e67e70d96 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:38.346736 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-e451d5c5-20d0-44fc-931b-187e67e70d96 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:38.353300 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e451d5c5-20d0-44fc-931b-187e67e70d96 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:38.353756 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e451d5c5-20d0-44fc-931b-187e67e70d96 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:38.354526 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e451d5c5-20d0-44fc-931b-187e67e70d96 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:38.354966 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e451d5c5-20d0-44fc-931b-187e67e70d96 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:38.493913 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-e451d5c5-20d0-44fc-931b-187e67e70d96 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba025a383c433b900a3f4ae64959b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf347b1959b247bcbe003ac3662cb239', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:38.502031 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-e451d5c5-20d0-44fc-931b-187e67e70d96 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213" status: 200 len: 1575 microversion: 2.1 time: 0.159770 Jul 28 18:21:38.503985 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 435/870] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:21:38 2022] GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213 => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:21:39.523611 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-7fd82b1f-cef7-4970-bf39-f7ad82037667 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:39.524269 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-7fd82b1f-cef7-4970-bf39-f7ad82037667 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:39.530869 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7fd82b1f-cef7-4970-bf39-f7ad82037667 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:39.531325 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7fd82b1f-cef7-4970-bf39-f7ad82037667 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:39.532113 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7fd82b1f-cef7-4970-bf39-f7ad82037667 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:39.532539 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7fd82b1f-cef7-4970-bf39-f7ad82037667 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:39.547672 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:21:39.663571 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-7fd82b1f-cef7-4970-bf39-f7ad82037667 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba025a383c433b900a3f4ae64959b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf347b1959b247bcbe003ac3662cb239', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:39.671896 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-7fd82b1f-cef7-4970-bf39-f7ad82037667 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213" status: 200 len: 1575 microversion: 2.1 time: 0.152172 Jul 28 18:21:39.672460 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 436/871] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:21:39 2022] GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213 => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:21:40.548028 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [req-330ee026-93cd-4cb0-af5c-716d31b833c0 req-195dc639-0222-4fae-9bb9-7e94f934080f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb0a115f-17bf-4501-af27-0802f70ac213", "name": "network-vif-plugged", "status": "completed", "tag": "5415e2f4-0f86-4921-bdc7-f0bf38bcd3e3"}]} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:21:40.559080 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-330ee026-93cd-4cb0-af5c-716d31b833c0 req-195dc639-0222-4fae-9bb9-7e94f934080f service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:40.559519 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-330ee026-93cd-4cb0-af5c-716d31b833c0 req-195dc639-0222-4fae-9bb9-7e94f934080f service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:40.571936 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.compute.server_external_events [req-330ee026-93cd-4cb0-af5c-716d31b833c0 req-195dc639-0222-4fae-9bb9-7e94f934080f service nova] Creating event network-vif-plugged:5415e2f4-0f86-4921-bdc7-f0bf38bcd3e3 for instance eb0a115f-17bf-4501-af27-0802f70ac213 on hv-cinder-84617 Jul 28 18:21:40.577726 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [req-330ee026-93cd-4cb0-af5c-716d31b833c0 req-195dc639-0222-4fae-9bb9-7e94f934080f service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033512 Jul 28 18:21:40.581714 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 436/872] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:21:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:21:40.694199 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-65de8e6e-1c7d-43d8-9aab-ec8ad8eb9303 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:40.694884 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-65de8e6e-1c7d-43d8-9aab-ec8ad8eb9303 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:40.701665 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-65de8e6e-1c7d-43d8-9aab-ec8ad8eb9303 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:40.702122 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-65de8e6e-1c7d-43d8-9aab-ec8ad8eb9303 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:40.702893 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-65de8e6e-1c7d-43d8-9aab-ec8ad8eb9303 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:40.703335 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-65de8e6e-1c7d-43d8-9aab-ec8ad8eb9303 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:40.835042 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-65de8e6e-1c7d-43d8-9aab-ec8ad8eb9303 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba025a383c433b900a3f4ae64959b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf347b1959b247bcbe003ac3662cb239', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:40.843251 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-65de8e6e-1c7d-43d8-9aab-ec8ad8eb9303 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213" status: 200 len: 1575 microversion: 2.1 time: 0.153042 Jul 28 18:21:40.843818 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 437/873] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:21:40 2022] GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:21:41.865046 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-2c09923a-b918-492a-8c87-10a619c3304a tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:41.865748 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-2c09923a-b918-492a-8c87-10a619c3304a tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:41.871968 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2c09923a-b918-492a-8c87-10a619c3304a tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:41.872418 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2c09923a-b918-492a-8c87-10a619c3304a tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:41.873840 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2c09923a-b918-492a-8c87-10a619c3304a tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:41.874284 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2c09923a-b918-492a-8c87-10a619c3304a tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:42.002558 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-2c09923a-b918-492a-8c87-10a619c3304a tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba025a383c433b900a3f4ae64959b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf347b1959b247bcbe003ac3662cb239', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:42.010352 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-2c09923a-b918-492a-8c87-10a619c3304a tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213" status: 200 len: 1575 microversion: 2.1 time: 0.150039 Jul 28 18:21:42.011130 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 437/874] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:21:41 2022] GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213 => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:21:42.698844 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3820129d-8713-4d3c-b526-5e6b24bf2a2f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:42.699363 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3820129d-8713-4d3c-b526-5e6b24bf2a2f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:42.706886 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3820129d-8713-4d3c-b526-5e6b24bf2a2f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:42.707338 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3820129d-8713-4d3c-b526-5e6b24bf2a2f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:42.708102 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3820129d-8713-4d3c-b526-5e6b24bf2a2f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:42.708540 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3820129d-8713-4d3c-b526-5e6b24bf2a2f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:42.731659 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-3820129d-8713-4d3c-b526-5e6b24bf2a2f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82/ips" status: 200 len: 151 microversion: 2.20 time: 0.036869 Jul 28 18:21:42.732301 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 438/875] 10.222.0.86 () {60 vars in 1289 bytes} [Thu Jul 28 18:21:42 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 18:21:43.031446 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-7a84bab7-09f4-48a5-8b73-241561fd5483 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:43.032071 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-7a84bab7-09f4-48a5-8b73-241561fd5483 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:43.038589 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-7a84bab7-09f4-48a5-8b73-241561fd5483 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:43.039055 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-7a84bab7-09f4-48a5-8b73-241561fd5483 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:43.039830 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-7a84bab7-09f4-48a5-8b73-241561fd5483 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:43.040278 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-7a84bab7-09f4-48a5-8b73-241561fd5483 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:43.178245 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-7a84bab7-09f4-48a5-8b73-241561fd5483 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba025a383c433b900a3f4ae64959b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf347b1959b247bcbe003ac3662cb239', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:43.186393 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-7a84bab7-09f4-48a5-8b73-241561fd5483 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213" status: 200 len: 1575 microversion: 2.1 time: 0.158909 Jul 28 18:21:43.186953 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 438/876] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:21:43 2022] GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:21:44.207738 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-50618c0d-0723-43d7-ac25-5e7c6aa01786 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:44.208432 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-50618c0d-0723-43d7-ac25-5e7c6aa01786 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:44.215245 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-50618c0d-0723-43d7-ac25-5e7c6aa01786 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:44.215697 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-50618c0d-0723-43d7-ac25-5e7c6aa01786 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:44.217148 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-50618c0d-0723-43d7-ac25-5e7c6aa01786 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:44.217593 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-50618c0d-0723-43d7-ac25-5e7c6aa01786 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:44.346499 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-50618c0d-0723-43d7-ac25-5e7c6aa01786 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba025a383c433b900a3f4ae64959b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf347b1959b247bcbe003ac3662cb239', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:44.354065 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-50618c0d-0723-43d7-ac25-5e7c6aa01786 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213" status: 200 len: 1562 microversion: 2.1 time: 0.150262 Jul 28 18:21:44.354645 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 439/877] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:21:44 2022] GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213 => generated 1562 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:21:45.965072 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-cb38de9b-8c7c-4b28-ab6d-3e6bc2430533 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:21:45.965636 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-cb38de9b-8c7c-4b28-ab6d-3e6bc2430533 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:45.972680 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-cb38de9b-8c7c-4b28-ab6d-3e6bc2430533 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:45.973173 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-cb38de9b-8c7c-4b28-ab6d-3e6bc2430533 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:45.973945 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-cb38de9b-8c7c-4b28-ab6d-3e6bc2430533 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:45.974387 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-cb38de9b-8c7c-4b28-ab6d-3e6bc2430533 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:45.996457 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.objects.instance [None req-cb38de9b-8c7c-4b28-ab6d-3e6bc2430533 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lazy-loading 'flavor' on Instance uuid 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 {{(pid=118454) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:21:46.397492 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-cb38de9b-8c7c-4b28-ab6d-3e6bc2430533 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "POST /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82/action" status: 202 len: 0 microversion: 2.20 time: 0.436551 Jul 28 18:21:46.398130 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 439/878] 10.222.0.86 () {62 vars in 1319 bytes} [Thu Jul 28 18:21:45 2022] POST /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82/action => generated 0 bytes in 438 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 18:21:46.406378 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d1f49812-5e36-481f-b558-5681cc4a8d76 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:46.406987 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-d1f49812-5e36-481f-b558-5681cc4a8d76 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:46.413561 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d1f49812-5e36-481f-b558-5681cc4a8d76 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:46.414011 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d1f49812-5e36-481f-b558-5681cc4a8d76 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:46.414807 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d1f49812-5e36-481f-b558-5681cc4a8d76 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:46.415242 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d1f49812-5e36-481f-b558-5681cc4a8d76 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:46.545463 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-d1f49812-5e36-481f-b558-5681cc4a8d76 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:46.553387 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-d1f49812-5e36-481f-b558-5681cc4a8d76 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:46.560651 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-d1f49812-5e36-481f-b558-5681cc4a8d76 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:46.560651 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-d1f49812-5e36-481f-b558-5681cc4a8d76 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1724 microversion: 2.20 time: 0.153611 Jul 28 18:21:46.560651 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 440/879] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:21:46 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:21:47.582653 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-adc28428-2a5a-4512-bb94-dfefdc2bb201 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:47.583355 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-adc28428-2a5a-4512-bb94-dfefdc2bb201 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:47.590818 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-adc28428-2a5a-4512-bb94-dfefdc2bb201 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:47.591268 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-adc28428-2a5a-4512-bb94-dfefdc2bb201 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:47.592064 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-adc28428-2a5a-4512-bb94-dfefdc2bb201 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:47.592507 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-adc28428-2a5a-4512-bb94-dfefdc2bb201 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:47.722649 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-adc28428-2a5a-4512-bb94-dfefdc2bb201 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:47.730532 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-adc28428-2a5a-4512-bb94-dfefdc2bb201 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:47.732556 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-adc28428-2a5a-4512-bb94-dfefdc2bb201 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:47.733761 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-adc28428-2a5a-4512-bb94-dfefdc2bb201 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1724 microversion: 2.20 time: 0.155874 Jul 28 18:21:47.734316 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 440/880] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:21:47 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:21:48.756663 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b6a83f82-1956-479d-afe4-39524d21844f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:48.757235 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b6a83f82-1956-479d-afe4-39524d21844f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:48.763985 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b6a83f82-1956-479d-afe4-39524d21844f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:48.764439 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b6a83f82-1956-479d-afe4-39524d21844f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:48.765229 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b6a83f82-1956-479d-afe4-39524d21844f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:48.765667 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b6a83f82-1956-479d-afe4-39524d21844f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:48.893213 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b6a83f82-1956-479d-afe4-39524d21844f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:48.901220 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b6a83f82-1956-479d-afe4-39524d21844f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:48.902723 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b6a83f82-1956-479d-afe4-39524d21844f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:48.903854 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b6a83f82-1956-479d-afe4-39524d21844f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1724 microversion: 2.20 time: 0.151307 Jul 28 18:21:48.904404 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 441/881] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:21:48 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:21:49.927300 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-96148ed1-0aef-4bdf-9ecb-3df838b3047e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:49.927949 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-96148ed1-0aef-4bdf-9ecb-3df838b3047e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:49.930386 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_api:SELECT=40 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:21:49.935287 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-96148ed1-0aef-4bdf-9ecb-3df838b3047e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:49.935743 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-96148ed1-0aef-4bdf-9ecb-3df838b3047e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:49.936512 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-96148ed1-0aef-4bdf-9ecb-3df838b3047e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:49.936956 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-96148ed1-0aef-4bdf-9ecb-3df838b3047e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:50.067824 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-96148ed1-0aef-4bdf-9ecb-3df838b3047e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:50.075624 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-96148ed1-0aef-4bdf-9ecb-3df838b3047e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:50.077694 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-96148ed1-0aef-4bdf-9ecb-3df838b3047e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:50.078857 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-96148ed1-0aef-4bdf-9ecb-3df838b3047e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1724 microversion: 2.20 time: 0.155555 Jul 28 18:21:50.079420 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 441/882] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:21:49 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:21:51.102401 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-61be926c-f74f-4403-b3c5-2e18b44695b9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:51.103011 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-61be926c-f74f-4403-b3c5-2e18b44695b9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:51.105497 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:21:51.110845 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-61be926c-f74f-4403-b3c5-2e18b44695b9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:51.111292 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-61be926c-f74f-4403-b3c5-2e18b44695b9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:51.112054 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-61be926c-f74f-4403-b3c5-2e18b44695b9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:51.112491 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-61be926c-f74f-4403-b3c5-2e18b44695b9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:51.246539 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-61be926c-f74f-4403-b3c5-2e18b44695b9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:51.254456 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-61be926c-f74f-4403-b3c5-2e18b44695b9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:51.255967 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-61be926c-f74f-4403-b3c5-2e18b44695b9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:51.257161 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-61be926c-f74f-4403-b3c5-2e18b44695b9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1724 microversion: 2.20 time: 0.158654 Jul 28 18:21:51.257722 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 442/883] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:21:51 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:21:52.279915 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-997b99ed-0b9a-4629-a17c-4a6b2c4847bc tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:52.280532 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-997b99ed-0b9a-4629-a17c-4a6b2c4847bc tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:52.287732 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-997b99ed-0b9a-4629-a17c-4a6b2c4847bc tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:52.288187 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-997b99ed-0b9a-4629-a17c-4a6b2c4847bc tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:52.288948 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-997b99ed-0b9a-4629-a17c-4a6b2c4847bc tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:52.289418 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-997b99ed-0b9a-4629-a17c-4a6b2c4847bc tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:52.421042 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-997b99ed-0b9a-4629-a17c-4a6b2c4847bc tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:52.429298 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-997b99ed-0b9a-4629-a17c-4a6b2c4847bc tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:52.430778 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-997b99ed-0b9a-4629-a17c-4a6b2c4847bc tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:52.431913 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-997b99ed-0b9a-4629-a17c-4a6b2c4847bc tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1724 microversion: 2.20 time: 0.156017 Jul 28 18:21:52.432464 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 442/884] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:21:52 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:21:53.455679 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b8f0b250-90b8-4af8-bc05-1a7a53affde1 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:53.456211 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b8f0b250-90b8-4af8-bc05-1a7a53affde1 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:53.462704 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b8f0b250-90b8-4af8-bc05-1a7a53affde1 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:53.463154 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b8f0b250-90b8-4af8-bc05-1a7a53affde1 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:53.464173 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b8f0b250-90b8-4af8-bc05-1a7a53affde1 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:53.464617 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b8f0b250-90b8-4af8-bc05-1a7a53affde1 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:53.592262 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b8f0b250-90b8-4af8-bc05-1a7a53affde1 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:53.600251 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b8f0b250-90b8-4af8-bc05-1a7a53affde1 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:53.601782 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b8f0b250-90b8-4af8-bc05-1a7a53affde1 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:53.602941 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b8f0b250-90b8-4af8-bc05-1a7a53affde1 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1724 microversion: 2.20 time: 0.151804 Jul 28 18:21:53.603506 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 443/885] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:21:53 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:21:54.625581 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-763a610c-c654-4f30-bd5a-33930fbcb9c0 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:54.626230 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-763a610c-c654-4f30-bd5a-33930fbcb9c0 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:54.633101 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-763a610c-c654-4f30-bd5a-33930fbcb9c0 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:54.633553 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-763a610c-c654-4f30-bd5a-33930fbcb9c0 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:54.634317 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-763a610c-c654-4f30-bd5a-33930fbcb9c0 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:54.634750 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-763a610c-c654-4f30-bd5a-33930fbcb9c0 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:54.764180 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-763a610c-c654-4f30-bd5a-33930fbcb9c0 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:54.772450 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-763a610c-c654-4f30-bd5a-33930fbcb9c0 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:54.774038 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-763a610c-c654-4f30-bd5a-33930fbcb9c0 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:54.775192 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-763a610c-c654-4f30-bd5a-33930fbcb9c0 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1724 microversion: 2.20 time: 0.153529 Jul 28 18:21:54.775742 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 443/886] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:21:54 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:21:55.799595 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-47eb7c91-322c-4318-a601-082786210d88 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:55.800275 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-47eb7c91-322c-4318-a601-082786210d88 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:55.806710 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-47eb7c91-322c-4318-a601-082786210d88 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:55.807167 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-47eb7c91-322c-4318-a601-082786210d88 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:55.807957 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-47eb7c91-322c-4318-a601-082786210d88 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:55.808434 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-47eb7c91-322c-4318-a601-082786210d88 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:55.941135 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-47eb7c91-322c-4318-a601-082786210d88 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:55.949595 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-47eb7c91-322c-4318-a601-082786210d88 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:55.951115 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-47eb7c91-322c-4318-a601-082786210d88 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:55.952268 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-47eb7c91-322c-4318-a601-082786210d88 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1724 microversion: 2.20 time: 0.157159 Jul 28 18:21:55.953366 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 444/887] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:21:55 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:21:56.975885 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-4633a101-83e5-4f57-a555-89f5e4175f23 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:56.976493 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-4633a101-83e5-4f57-a555-89f5e4175f23 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:56.983210 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-4633a101-83e5-4f57-a555-89f5e4175f23 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:56.983661 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-4633a101-83e5-4f57-a555-89f5e4175f23 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:56.984423 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-4633a101-83e5-4f57-a555-89f5e4175f23 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:56.984860 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-4633a101-83e5-4f57-a555-89f5e4175f23 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:57.110891 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-4633a101-83e5-4f57-a555-89f5e4175f23 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:57.118882 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-4633a101-83e5-4f57-a555-89f5e4175f23 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:57.120386 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-4633a101-83e5-4f57-a555-89f5e4175f23 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:57.121580 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-4633a101-83e5-4f57-a555-89f5e4175f23 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1724 microversion: 2.20 time: 0.149701 Jul 28 18:21:57.127513 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 444/888] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:21:56 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:21:58.145362 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ee956bf8-e921-4e1b-8caf-6b894c4ab637 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:58.145972 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ee956bf8-e921-4e1b-8caf-6b894c4ab637 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:58.152437 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ee956bf8-e921-4e1b-8caf-6b894c4ab637 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:58.152890 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ee956bf8-e921-4e1b-8caf-6b894c4ab637 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:58.153682 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ee956bf8-e921-4e1b-8caf-6b894c4ab637 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:58.154119 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ee956bf8-e921-4e1b-8caf-6b894c4ab637 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:58.289739 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ee956bf8-e921-4e1b-8caf-6b894c4ab637 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:58.297621 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ee956bf8-e921-4e1b-8caf-6b894c4ab637 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:58.299136 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ee956bf8-e921-4e1b-8caf-6b894c4ab637 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:58.300290 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ee956bf8-e921-4e1b-8caf-6b894c4ab637 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1724 microversion: 2.20 time: 0.158869 Jul 28 18:21:58.300847 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 445/889] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:21:58 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:21:59.322986 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-44873e87-5c16-4380-ac9d-91d65a95b790 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:21:59.323587 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-44873e87-5c16-4380-ac9d-91d65a95b790 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:21:59.333083 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-44873e87-5c16-4380-ac9d-91d65a95b790 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:59.333534 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-44873e87-5c16-4380-ac9d-91d65a95b790 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:59.334301 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-44873e87-5c16-4380-ac9d-91d65a95b790 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:21:59.334734 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-44873e87-5c16-4380-ac9d-91d65a95b790 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:21:59.464200 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-44873e87-5c16-4380-ac9d-91d65a95b790 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:59.471993 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-44873e87-5c16-4380-ac9d-91d65a95b790 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:59.473556 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-44873e87-5c16-4380-ac9d-91d65a95b790 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:21:59.474700 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-44873e87-5c16-4380-ac9d-91d65a95b790 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1724 microversion: 2.20 time: 0.155694 Jul 28 18:21:59.475252 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 445/890] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:21:59 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:22:00.497614 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ec877f4f-68bc-44ed-bc53-531943b70e08 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:22:00.498226 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ec877f4f-68bc-44ed-bc53-531943b70e08 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:22:00.504770 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ec877f4f-68bc-44ed-bc53-531943b70e08 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:00.505215 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ec877f4f-68bc-44ed-bc53-531943b70e08 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:00.505987 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ec877f4f-68bc-44ed-bc53-531943b70e08 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:00.506434 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ec877f4f-68bc-44ed-bc53-531943b70e08 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:00.642552 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ec877f4f-68bc-44ed-bc53-531943b70e08 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:00.650864 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ec877f4f-68bc-44ed-bc53-531943b70e08 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:00.652392 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ec877f4f-68bc-44ed-bc53-531943b70e08 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:00.653568 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ec877f4f-68bc-44ed-bc53-531943b70e08 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1724 microversion: 2.20 time: 0.159892 Jul 28 18:22:00.654132 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 446/891] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:22:00 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:22:01.677559 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-bd4e8c6a-978f-4a27-9c06-fa146f6d1a55 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:22:01.678193 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-bd4e8c6a-978f-4a27-9c06-fa146f6d1a55 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:22:01.684648 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-bd4e8c6a-978f-4a27-9c06-fa146f6d1a55 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:01.685140 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-bd4e8c6a-978f-4a27-9c06-fa146f6d1a55 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:01.685904 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-bd4e8c6a-978f-4a27-9c06-fa146f6d1a55 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:01.686353 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-bd4e8c6a-978f-4a27-9c06-fa146f6d1a55 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:01.815739 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-bd4e8c6a-978f-4a27-9c06-fa146f6d1a55 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:01.823600 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-bd4e8c6a-978f-4a27-9c06-fa146f6d1a55 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:01.825163 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-bd4e8c6a-978f-4a27-9c06-fa146f6d1a55 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:01.826308 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-bd4e8c6a-978f-4a27-9c06-fa146f6d1a55 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1724 microversion: 2.20 time: 0.153418 Jul 28 18:22:01.826856 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 446/892] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:22:01 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:22:02.849246 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-569754a5-6c10-4dbd-b1cd-13c30234346d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:22:02.849884 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-569754a5-6c10-4dbd-b1cd-13c30234346d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:22:02.856428 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-569754a5-6c10-4dbd-b1cd-13c30234346d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:02.856873 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-569754a5-6c10-4dbd-b1cd-13c30234346d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:02.857664 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-569754a5-6c10-4dbd-b1cd-13c30234346d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:02.858093 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-569754a5-6c10-4dbd-b1cd-13c30234346d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:02.983705 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-569754a5-6c10-4dbd-b1cd-13c30234346d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:02.991490 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-569754a5-6c10-4dbd-b1cd-13c30234346d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:02.992996 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-569754a5-6c10-4dbd-b1cd-13c30234346d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:02.994136 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-569754a5-6c10-4dbd-b1cd-13c30234346d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1724 microversion: 2.20 time: 0.149502 Jul 28 18:22:02.994688 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 447/893] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:22:02 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:22:04.018451 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-aeaa3c4e-891a-4365-9844-9f4dbe4a1965 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:22:04.019158 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-aeaa3c4e-891a-4365-9844-9f4dbe4a1965 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:22:04.026214 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-aeaa3c4e-891a-4365-9844-9f4dbe4a1965 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:04.026729 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-aeaa3c4e-891a-4365-9844-9f4dbe4a1965 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:04.027508 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-aeaa3c4e-891a-4365-9844-9f4dbe4a1965 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:04.027986 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-aeaa3c4e-891a-4365-9844-9f4dbe4a1965 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:04.032509 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:22:04.161679 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-aeaa3c4e-891a-4365-9844-9f4dbe4a1965 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:04.169439 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-aeaa3c4e-891a-4365-9844-9f4dbe4a1965 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:04.170958 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-aeaa3c4e-891a-4365-9844-9f4dbe4a1965 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:04.172176 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-aeaa3c4e-891a-4365-9844-9f4dbe4a1965 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1745 microversion: 2.20 time: 0.158087 Jul 28 18:22:04.172721 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 447/894] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:22:04 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:22:05.196360 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-041d0293-5aa7-4397-8440-12e56a581b4b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:22:05.196989 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-041d0293-5aa7-4397-8440-12e56a581b4b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:22:05.203539 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-041d0293-5aa7-4397-8440-12e56a581b4b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:05.203991 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-041d0293-5aa7-4397-8440-12e56a581b4b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:05.204750 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-041d0293-5aa7-4397-8440-12e56a581b4b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:05.205891 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-041d0293-5aa7-4397-8440-12e56a581b4b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:05.338715 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-041d0293-5aa7-4397-8440-12e56a581b4b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:05.346935 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-041d0293-5aa7-4397-8440-12e56a581b4b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:05.349673 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-041d0293-5aa7-4397-8440-12e56a581b4b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:05.350819 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-041d0293-5aa7-4397-8440-12e56a581b4b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1745 microversion: 2.20 time: 0.158489 Jul 28 18:22:05.351382 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 448/895] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:22:05 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:22:06.373957 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-eb0a2d8f-0b84-41be-8909-38c97bfb8ebc tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:22:06.374572 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-eb0a2d8f-0b84-41be-8909-38c97bfb8ebc tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:22:06.381362 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-eb0a2d8f-0b84-41be-8909-38c97bfb8ebc tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:06.381817 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-eb0a2d8f-0b84-41be-8909-38c97bfb8ebc tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:06.382585 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-eb0a2d8f-0b84-41be-8909-38c97bfb8ebc tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:06.383025 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-eb0a2d8f-0b84-41be-8909-38c97bfb8ebc tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:06.513520 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-eb0a2d8f-0b84-41be-8909-38c97bfb8ebc tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:06.522062 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-eb0a2d8f-0b84-41be-8909-38c97bfb8ebc tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:06.523576 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-eb0a2d8f-0b84-41be-8909-38c97bfb8ebc tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:06.524765 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-eb0a2d8f-0b84-41be-8909-38c97bfb8ebc tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1745 microversion: 2.20 time: 0.155109 Jul 28 18:22:06.525372 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 448/896] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:22:06 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:22:07.548280 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-16a8bad1-a675-4168-9876-509682b646a1 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:22:07.549468 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-16a8bad1-a675-4168-9876-509682b646a1 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:22:07.555942 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-16a8bad1-a675-4168-9876-509682b646a1 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:07.556411 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-16a8bad1-a675-4168-9876-509682b646a1 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:07.557186 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-16a8bad1-a675-4168-9876-509682b646a1 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:07.557631 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-16a8bad1-a675-4168-9876-509682b646a1 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:07.691191 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-16a8bad1-a675-4168-9876-509682b646a1 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:07.699173 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-16a8bad1-a675-4168-9876-509682b646a1 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:07.700689 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-16a8bad1-a675-4168-9876-509682b646a1 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:07.701875 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-16a8bad1-a675-4168-9876-509682b646a1 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1745 microversion: 2.20 time: 0.157577 Jul 28 18:22:07.702437 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 449/897] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:22:07 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:22:08.725549 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-467e433e-9b38-435d-b9f5-707fb185b2b9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:22:08.726097 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-467e433e-9b38-435d-b9f5-707fb185b2b9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:22:08.733070 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-467e433e-9b38-435d-b9f5-707fb185b2b9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:08.733523 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-467e433e-9b38-435d-b9f5-707fb185b2b9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:08.734295 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-467e433e-9b38-435d-b9f5-707fb185b2b9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:08.734808 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-467e433e-9b38-435d-b9f5-707fb185b2b9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:08.793460 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-bdff5971-6794-4f8a-8417-1dccca728a44 req-8288a7e6-832f-4c61-8114-5c1dd00dbf24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f14e236-1f43-4ff7-bf3d-ae1f6a084b82", "name": "network-vif-plugged", "status": "completed", "tag": "0069c542-1991-42af-bff0-348765fbb55f"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:22:08.804755 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-bdff5971-6794-4f8a-8417-1dccca728a44 req-8288a7e6-832f-4c61-8114-5c1dd00dbf24 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:08.805233 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-bdff5971-6794-4f8a-8417-1dccca728a44 req-8288a7e6-832f-4c61-8114-5c1dd00dbf24 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:08.816541 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-bdff5971-6794-4f8a-8417-1dccca728a44 req-8288a7e6-832f-4c61-8114-5c1dd00dbf24 service nova] Creating event network-vif-plugged:0069c542-1991-42af-bff0-348765fbb55f for instance 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 on hv-cinder-84617 Jul 28 18:22:08.821671 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-bdff5971-6794-4f8a-8417-1dccca728a44 req-8288a7e6-832f-4c61-8114-5c1dd00dbf24 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031917 Jul 28 18:22:08.822260 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 450/898] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:22:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 18:22:08.870325 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-467e433e-9b38-435d-b9f5-707fb185b2b9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:08.879199 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-467e433e-9b38-435d-b9f5-707fb185b2b9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:08.880691 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-467e433e-9b38-435d-b9f5-707fb185b2b9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:08.882034 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-467e433e-9b38-435d-b9f5-707fb185b2b9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1745 microversion: 2.20 time: 0.160966 Jul 28 18:22:08.882585 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 449/899] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:22:08 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1745 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:22:09.905852 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-47f52e33-26a0-4bd2-90e8-ef832a9e4a0f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:22:09.906461 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-47f52e33-26a0-4bd2-90e8-ef832a9e4a0f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:22:09.912703 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-47f52e33-26a0-4bd2-90e8-ef832a9e4a0f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:09.913195 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-47f52e33-26a0-4bd2-90e8-ef832a9e4a0f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:09.913971 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-47f52e33-26a0-4bd2-90e8-ef832a9e4a0f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:09.914411 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-47f52e33-26a0-4bd2-90e8-ef832a9e4a0f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:09.918350 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=82 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:22:10.045397 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-47f52e33-26a0-4bd2-90e8-ef832a9e4a0f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:10.053362 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-47f52e33-26a0-4bd2-90e8-ef832a9e4a0f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:10.054881 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-47f52e33-26a0-4bd2-90e8-ef832a9e4a0f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:10.056038 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-47f52e33-26a0-4bd2-90e8-ef832a9e4a0f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1745 microversion: 2.20 time: 0.155055 Jul 28 18:22:10.056602 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 451/900] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:22:09 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:22:11.079310 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-08d95e18-3669-4a29-8c0e-1d4bbce5b413 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:22:11.079922 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-08d95e18-3669-4a29-8c0e-1d4bbce5b413 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:22:11.086521 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-08d95e18-3669-4a29-8c0e-1d4bbce5b413 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:11.086975 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-08d95e18-3669-4a29-8c0e-1d4bbce5b413 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:11.087741 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-08d95e18-3669-4a29-8c0e-1d4bbce5b413 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:11.088439 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-08d95e18-3669-4a29-8c0e-1d4bbce5b413 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:11.217219 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-08d95e18-3669-4a29-8c0e-1d4bbce5b413 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:11.225673 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-08d95e18-3669-4a29-8c0e-1d4bbce5b413 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:11.235477 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-08d95e18-3669-4a29-8c0e-1d4bbce5b413 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:11.235477 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-08d95e18-3669-4a29-8c0e-1d4bbce5b413 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1745 microversion: 2.20 time: 0.153021 Jul 28 18:22:11.235477 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 450/901] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:22:11 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:22:12.252325 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-6d741b0b-475a-4d4e-a6ac-0b819d0f0bef tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:22:12.253128 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-6d741b0b-475a-4d4e-a6ac-0b819d0f0bef tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:22:12.259141 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6d741b0b-475a-4d4e-a6ac-0b819d0f0bef tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:12.264121 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6d741b0b-475a-4d4e-a6ac-0b819d0f0bef tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:12.264121 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6d741b0b-475a-4d4e-a6ac-0b819d0f0bef tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:12.264121 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6d741b0b-475a-4d4e-a6ac-0b819d0f0bef tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:12.398709 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-6d741b0b-475a-4d4e-a6ac-0b819d0f0bef tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:12.406748 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-6d741b0b-475a-4d4e-a6ac-0b819d0f0bef tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:12.408900 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-6d741b0b-475a-4d4e-a6ac-0b819d0f0bef tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:12.410107 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-6d741b0b-475a-4d4e-a6ac-0b819d0f0bef tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1740 microversion: 2.20 time: 0.162324 Jul 28 18:22:12.410665 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 452/902] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:22:12 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1740 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:22:13.434884 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-08e7e64a-dda8-40f7-8836-2cda5f6961a5 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:22:13.435503 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-08e7e64a-dda8-40f7-8836-2cda5f6961a5 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:22:13.442757 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-08e7e64a-dda8-40f7-8836-2cda5f6961a5 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:13.443143 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-08e7e64a-dda8-40f7-8836-2cda5f6961a5 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:13.443906 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-08e7e64a-dda8-40f7-8836-2cda5f6961a5 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:13.444339 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-08e7e64a-dda8-40f7-8836-2cda5f6961a5 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:13.580587 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-08e7e64a-dda8-40f7-8836-2cda5f6961a5 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:13.588837 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-08e7e64a-dda8-40f7-8836-2cda5f6961a5 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:13.590655 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-08e7e64a-dda8-40f7-8836-2cda5f6961a5 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:13.591814 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-08e7e64a-dda8-40f7-8836-2cda5f6961a5 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1740 microversion: 2.20 time: 0.161598 Jul 28 18:22:13.592366 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 451/903] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:22:13 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1740 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:22:14.616129 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-8d655a40-c6e9-4536-a618-f10bd78c189e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:22:14.616744 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-8d655a40-c6e9-4536-a618-f10bd78c189e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:22:14.623426 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8d655a40-c6e9-4536-a618-f10bd78c189e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:14.623878 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8d655a40-c6e9-4536-a618-f10bd78c189e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:14.624647 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8d655a40-c6e9-4536-a618-f10bd78c189e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:14.625301 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8d655a40-c6e9-4536-a618-f10bd78c189e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:14.763228 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8d655a40-c6e9-4536-a618-f10bd78c189e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:14.772314 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8d655a40-c6e9-4536-a618-f10bd78c189e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:14.774064 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8d655a40-c6e9-4536-a618-f10bd78c189e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:14.775300 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-8d655a40-c6e9-4536-a618-f10bd78c189e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1740 microversion: 2.20 time: 0.163058 Jul 28 18:22:14.775958 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 453/904] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:22:14 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1740 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:22:15.798249 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-070dedd1-b1e4-4c7a-baf0-4ed98839b597 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:22:15.798805 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-070dedd1-b1e4-4c7a-baf0-4ed98839b597 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:22:15.805849 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-070dedd1-b1e4-4c7a-baf0-4ed98839b597 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:15.806304 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-070dedd1-b1e4-4c7a-baf0-4ed98839b597 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:15.807119 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-070dedd1-b1e4-4c7a-baf0-4ed98839b597 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:15.807638 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-070dedd1-b1e4-4c7a-baf0-4ed98839b597 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:15.945030 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-070dedd1-b1e4-4c7a-baf0-4ed98839b597 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:15.953142 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-070dedd1-b1e4-4c7a-baf0-4ed98839b597 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:15.954750 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-070dedd1-b1e4-4c7a-baf0-4ed98839b597 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:15.955934 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-070dedd1-b1e4-4c7a-baf0-4ed98839b597 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1740 microversion: 2.20 time: 0.161758 Jul 28 18:22:15.957648 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 452/905] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:22:15 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1740 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:22:16.981901 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-72ec6234-1a9a-4fc8-a891-8502fb74c748 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:22:16.982661 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-72ec6234-1a9a-4fc8-a891-8502fb74c748 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:22:16.989852 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-72ec6234-1a9a-4fc8-a891-8502fb74c748 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:16.990332 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-72ec6234-1a9a-4fc8-a891-8502fb74c748 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:16.991160 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-72ec6234-1a9a-4fc8-a891-8502fb74c748 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:16.991605 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-72ec6234-1a9a-4fc8-a891-8502fb74c748 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:17.144851 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-72ec6234-1a9a-4fc8-a891-8502fb74c748 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:17.153405 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-72ec6234-1a9a-4fc8-a891-8502fb74c748 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:17.154771 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-72ec6234-1a9a-4fc8-a891-8502fb74c748 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:17.155929 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-72ec6234-1a9a-4fc8-a891-8502fb74c748 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1740 microversion: 2.20 time: 0.180216 Jul 28 18:22:17.156498 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 454/906] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:22:16 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1740 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:22:18.183486 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-f8c87774-3297-4384-a77a-e2028a91d6e3 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:22:18.184377 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-f8c87774-3297-4384-a77a-e2028a91d6e3 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:22:18.193401 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f8c87774-3297-4384-a77a-e2028a91d6e3 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:18.194064 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f8c87774-3297-4384-a77a-e2028a91d6e3 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:18.194920 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f8c87774-3297-4384-a77a-e2028a91d6e3 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:18.195420 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f8c87774-3297-4384-a77a-e2028a91d6e3 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:18.353420 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-f8c87774-3297-4384-a77a-e2028a91d6e3 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:18.364796 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-f8c87774-3297-4384-a77a-e2028a91d6e3 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:18.365410 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-f8c87774-3297-4384-a77a-e2028a91d6e3 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:18.366715 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-f8c87774-3297-4384-a77a-e2028a91d6e3 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1740 microversion: 2.20 time: 0.191387 Jul 28 18:22:18.367794 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 453/907] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:22:18 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1740 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:22:19.391047 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f0ed820e-23fa-4261-83a9-d9a1ed5081f9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:22:19.391653 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f0ed820e-23fa-4261-83a9-d9a1ed5081f9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:22:19.399365 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f0ed820e-23fa-4261-83a9-d9a1ed5081f9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:19.400059 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f0ed820e-23fa-4261-83a9-d9a1ed5081f9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:19.400720 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f0ed820e-23fa-4261-83a9-d9a1ed5081f9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:19.401197 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f0ed820e-23fa-4261-83a9-d9a1ed5081f9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:19.549829 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f0ed820e-23fa-4261-83a9-d9a1ed5081f9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:19.558679 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f0ed820e-23fa-4261-83a9-d9a1ed5081f9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:19.560193 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f0ed820e-23fa-4261-83a9-d9a1ed5081f9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:19.561446 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f0ed820e-23fa-4261-83a9-d9a1ed5081f9 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1740 microversion: 2.20 time: 0.174387 Jul 28 18:22:19.562207 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 455/908] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:22:19 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1740 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:22:20.584813 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-59bef87e-0f4c-4980-b6cf-ce36bf74307f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:22:20.585572 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-59bef87e-0f4c-4980-b6cf-ce36bf74307f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:22:20.588263 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_api:SELECT=26 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:22:20.593031 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-59bef87e-0f4c-4980-b6cf-ce36bf74307f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:20.593482 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-59bef87e-0f4c-4980-b6cf-ce36bf74307f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:20.594239 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-59bef87e-0f4c-4980-b6cf-ce36bf74307f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:20.594680 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-59bef87e-0f4c-4980-b6cf-ce36bf74307f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:20.732124 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-59bef87e-0f4c-4980-b6cf-ce36bf74307f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:20.740749 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-59bef87e-0f4c-4980-b6cf-ce36bf74307f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:20.742288 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-59bef87e-0f4c-4980-b6cf-ce36bf74307f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:20.743435 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-59bef87e-0f4c-4980-b6cf-ce36bf74307f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1740 microversion: 2.20 time: 0.162516 Jul 28 18:22:20.743986 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 454/909] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:22:20 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1740 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:22:21.766949 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-909ef2ef-806a-4b0a-8a26-3eccd4864a80 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:22:21.767800 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-909ef2ef-806a-4b0a-8a26-3eccd4864a80 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:22:21.774229 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=28 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:22:21.775999 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-909ef2ef-806a-4b0a-8a26-3eccd4864a80 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:21.776449 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-909ef2ef-806a-4b0a-8a26-3eccd4864a80 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:21.777242 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-909ef2ef-806a-4b0a-8a26-3eccd4864a80 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:21.777683 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-909ef2ef-806a-4b0a-8a26-3eccd4864a80 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:21.918002 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-909ef2ef-806a-4b0a-8a26-3eccd4864a80 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:21.927082 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-909ef2ef-806a-4b0a-8a26-3eccd4864a80 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:21.928590 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-909ef2ef-806a-4b0a-8a26-3eccd4864a80 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:21.929787 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-909ef2ef-806a-4b0a-8a26-3eccd4864a80 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1740 microversion: 2.20 time: 0.166903 Jul 28 18:22:21.934882 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 456/910] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:22:21 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1740 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:22:22.953857 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-46db179a-17f3-428e-bb3a-f4d75c6b2081 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:22:22.954398 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-46db179a-17f3-428e-bb3a-f4d75c6b2081 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:22:22.961637 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-46db179a-17f3-428e-bb3a-f4d75c6b2081 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:22.962094 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-46db179a-17f3-428e-bb3a-f4d75c6b2081 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:22.963338 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-46db179a-17f3-428e-bb3a-f4d75c6b2081 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:22.963819 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-46db179a-17f3-428e-bb3a-f4d75c6b2081 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:23.105271 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-46db179a-17f3-428e-bb3a-f4d75c6b2081 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:23.124404 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-46db179a-17f3-428e-bb3a-f4d75c6b2081 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:23.127036 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-46db179a-17f3-428e-bb3a-f4d75c6b2081 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:23.130945 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-46db179a-17f3-428e-bb3a-f4d75c6b2081 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1740 microversion: 2.20 time: 0.180218 Jul 28 18:22:23.132026 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 455/911] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:22:22 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1740 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:22:24.160526 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-107cb998-990e-4a9f-8b39-1b5fca2f4483 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:22:24.189802 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-107cb998-990e-4a9f-8b39-1b5fca2f4483 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:22:24.189802 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-107cb998-990e-4a9f-8b39-1b5fca2f4483 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:24.189802 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-107cb998-990e-4a9f-8b39-1b5fca2f4483 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:24.189802 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-107cb998-990e-4a9f-8b39-1b5fca2f4483 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:24.191057 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-107cb998-990e-4a9f-8b39-1b5fca2f4483 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:24.328627 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-107cb998-990e-4a9f-8b39-1b5fca2f4483 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:24.339239 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-107cb998-990e-4a9f-8b39-1b5fca2f4483 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:24.341671 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-107cb998-990e-4a9f-8b39-1b5fca2f4483 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:24.342909 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-107cb998-990e-4a9f-8b39-1b5fca2f4483 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1740 microversion: 2.20 time: 0.187119 Jul 28 18:22:24.343481 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 457/912] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:22:24 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1740 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:22:25.367679 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-b4809ad9-89dd-4f6f-9f16-b03993389f8d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:22:25.368423 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-b4809ad9-89dd-4f6f-9f16-b03993389f8d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:22:25.375239 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b4809ad9-89dd-4f6f-9f16-b03993389f8d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:25.375694 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b4809ad9-89dd-4f6f-9f16-b03993389f8d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:25.376467 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b4809ad9-89dd-4f6f-9f16-b03993389f8d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:25.376959 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b4809ad9-89dd-4f6f-9f16-b03993389f8d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:25.517515 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-b4809ad9-89dd-4f6f-9f16-b03993389f8d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:25.533579 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-b4809ad9-89dd-4f6f-9f16-b03993389f8d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:25.535912 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-b4809ad9-89dd-4f6f-9f16-b03993389f8d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:25.537326 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-b4809ad9-89dd-4f6f-9f16-b03993389f8d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1740 microversion: 2.20 time: 0.173664 Jul 28 18:22:25.538397 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 456/913] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:22:25 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1740 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:22:26.563214 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-e69633e8-005d-4a1b-8fe8-07ad281a3e3a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:22:26.564077 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-e69633e8-005d-4a1b-8fe8-07ad281a3e3a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:22:26.571527 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e69633e8-005d-4a1b-8fe8-07ad281a3e3a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:26.574223 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e69633e8-005d-4a1b-8fe8-07ad281a3e3a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:26.574223 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e69633e8-005d-4a1b-8fe8-07ad281a3e3a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:26.574223 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e69633e8-005d-4a1b-8fe8-07ad281a3e3a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:26.706457 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-e69633e8-005d-4a1b-8fe8-07ad281a3e3a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:26.714584 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-e69633e8-005d-4a1b-8fe8-07ad281a3e3a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:26.716094 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-e69633e8-005d-4a1b-8fe8-07ad281a3e3a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:26.717283 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-e69633e8-005d-4a1b-8fe8-07ad281a3e3a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1740 microversion: 2.20 time: 0.157906 Jul 28 18:22:26.717853 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 458/914] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:22:26 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1740 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:22:27.739721 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-0e6d7b27-9379-435d-ba81-be8e3adb984d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:22:27.740336 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-0e6d7b27-9379-435d-ba81-be8e3adb984d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:22:27.746953 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-0e6d7b27-9379-435d-ba81-be8e3adb984d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:27.747404 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-0e6d7b27-9379-435d-ba81-be8e3adb984d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:27.748179 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-0e6d7b27-9379-435d-ba81-be8e3adb984d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:27.748620 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-0e6d7b27-9379-435d-ba81-be8e3adb984d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:28.010385 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-0e6d7b27-9379-435d-ba81-be8e3adb984d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:28.019212 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-0e6d7b27-9379-435d-ba81-be8e3adb984d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:28.020738 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-0e6d7b27-9379-435d-ba81-be8e3adb984d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:28.021924 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-0e6d7b27-9379-435d-ba81-be8e3adb984d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1722 microversion: 2.20 time: 0.286229 Jul 28 18:22:28.022493 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 457/915] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:22:27 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1722 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:22:29.044166 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-08374ad3-ab31-42c3-868a-466ca49df88e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:22:29.044762 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-08374ad3-ab31-42c3-868a-466ca49df88e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:22:29.051265 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-08374ad3-ab31-42c3-868a-466ca49df88e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:29.051719 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-08374ad3-ab31-42c3-868a-466ca49df88e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:29.052478 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-08374ad3-ab31-42c3-868a-466ca49df88e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:29.052920 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-08374ad3-ab31-42c3-868a-466ca49df88e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:29.235872 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-08374ad3-ab31-42c3-868a-466ca49df88e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:29.244407 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-08374ad3-ab31-42c3-868a-466ca49df88e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:29.245949 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-08374ad3-ab31-42c3-868a-466ca49df88e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:29.247094 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-08374ad3-ab31-42c3-868a-466ca49df88e tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1722 microversion: 2.20 time: 0.206892 Jul 28 18:22:29.247646 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 459/916] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:22:29 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1722 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:22:30.269982 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-33090c5f-a9bb-4730-b82e-1584670d1f1b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:22:30.270667 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-33090c5f-a9bb-4730-b82e-1584670d1f1b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:22:30.277323 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-33090c5f-a9bb-4730-b82e-1584670d1f1b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:30.277774 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-33090c5f-a9bb-4730-b82e-1584670d1f1b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:30.278550 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-33090c5f-a9bb-4730-b82e-1584670d1f1b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:30.279280 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-33090c5f-a9bb-4730-b82e-1584670d1f1b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:30.436207 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-33090c5f-a9bb-4730-b82e-1584670d1f1b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:30.445021 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-33090c5f-a9bb-4730-b82e-1584670d1f1b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:30.446745 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-33090c5f-a9bb-4730-b82e-1584670d1f1b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:30.447945 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-33090c5f-a9bb-4730-b82e-1584670d1f1b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1725 microversion: 2.20 time: 0.182013 Jul 28 18:22:30.448519 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 458/917] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:22:30 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1725 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:22:30.471475 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-c5622de4-5263-4608-921d-7257bf65cb5d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a841173f-9b18-4c5f-8b29-f849dc8dabb7"}} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:22:30.475000 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-c5622de4-5263-4608-921d-7257bf65cb5d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:22:30.480350 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c5622de4-5263-4608-921d-7257bf65cb5d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:30.480874 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c5622de4-5263-4608-921d-7257bf65cb5d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:30.481686 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c5622de4-5263-4608-921d-7257bf65cb5d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:30.482125 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c5622de4-5263-4608-921d-7257bf65cb5d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:30.705779 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [req-9fd16d53-69a2-4143-a4a9-d0be71da562d req-4a753352-fe70-4f18-b0d1-a57cda1c7585 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f14e236-1f43-4ff7-bf3d-ae1f6a084b82", "name": "network-vif-unplugged", "status": "completed", "tag": "0069c542-1991-42af-bff0-348765fbb55f"}]} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:22:30.716511 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-9fd16d53-69a2-4143-a4a9-d0be71da562d req-4a753352-fe70-4f18-b0d1-a57cda1c7585 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:30.716998 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-9fd16d53-69a2-4143-a4a9-d0be71da562d req-4a753352-fe70-4f18-b0d1-a57cda1c7585 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:30.728953 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.compute.server_external_events [req-9fd16d53-69a2-4143-a4a9-d0be71da562d req-4a753352-fe70-4f18-b0d1-a57cda1c7585 service nova] Creating event network-vif-unplugged:0069c542-1991-42af-bff0-348765fbb55f for instance 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 on hv-cinder-84617 Jul 28 18:22:30.734383 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [req-9fd16d53-69a2-4143-a4a9-d0be71da562d req-4a753352-fe70-4f18-b0d1-a57cda1c7585 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032443 Jul 28 18:22:30.735209 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 459/918] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:22:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 18:22:31.529095 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-c5622de4-5263-4608-921d-7257bf65cb5d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "POST /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.061530 Jul 28 18:22:31.529974 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 460/919] 10.222.0.86 () {62 vars in 1364 bytes} [Thu Jul 28 18:22:30 2022] POST /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82/os-volume_attachments => generated 188 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 18:22:31.660381 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-336ccb4e-aeb1-491c-be4a-7d481326b681 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:22:31.661020 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-336ccb4e-aeb1-491c-be4a-7d481326b681 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:22:31.667709 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-336ccb4e-aeb1-491c-be4a-7d481326b681 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:31.668164 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-336ccb4e-aeb1-491c-be4a-7d481326b681 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:31.668929 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-336ccb4e-aeb1-491c-be4a-7d481326b681 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:31.669392 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-336ccb4e-aeb1-491c-be4a-7d481326b681 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:32.287701 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-336ccb4e-aeb1-491c-be4a-7d481326b681 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "DELETE /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82/os-volume_attachments/a841173f-9b18-4c5f-8b29-f849dc8dabb7" status: 202 len: 0 microversion: 2.20 time: 0.632080 Jul 28 18:22:32.288307 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 460/920] 10.222.0.86 () {60 vars in 1457 bytes} [Thu Jul 28 18:22:31 2022] DELETE /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82/os-volume_attachments/a841173f-9b18-4c5f-8b29-f849dc8dabb7 => generated 0 bytes in 634 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 18:22:32.347829 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3a36cf96-b8cd-4106-abfa-e0b7c85f3dda tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:22:32.348547 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3a36cf96-b8cd-4106-abfa-e0b7c85f3dda tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:22:32.354707 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3a36cf96-b8cd-4106-abfa-e0b7c85f3dda tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:32.359928 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3a36cf96-b8cd-4106-abfa-e0b7c85f3dda tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:32.359928 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3a36cf96-b8cd-4106-abfa-e0b7c85f3dda tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:32.359928 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3a36cf96-b8cd-4106-abfa-e0b7c85f3dda tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:32.386008 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3a36cf96-b8cd-4106-abfa-e0b7c85f3dda tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118453) unshelve /opt/stack/nova/nova/compute/api.py:4532}} Jul 28 18:22:32.674156 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-3a36cf96-b8cd-4106-abfa-e0b7c85f3dda tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "POST /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82/action" status: 202 len: 0 microversion: 2.20 time: 0.330424 Jul 28 18:22:32.675165 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 461/921] 10.222.0.86 () {62 vars in 1319 bytes} [Thu Jul 28 18:22:32 2022] POST /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82/action => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 28 18:22:32.682927 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-0eafbd75-2d48-4688-8e88-ba652b772c65 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:22:32.683640 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-0eafbd75-2d48-4688-8e88-ba652b772c65 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:22:32.691238 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-0eafbd75-2d48-4688-8e88-ba652b772c65 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:32.691697 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-0eafbd75-2d48-4688-8e88-ba652b772c65 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:32.692485 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-0eafbd75-2d48-4688-8e88-ba652b772c65 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:32.692941 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-0eafbd75-2d48-4688-8e88-ba652b772c65 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:32.826163 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-0eafbd75-2d48-4688-8e88-ba652b772c65 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:32.829821 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:22:32.835752 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-0eafbd75-2d48-4688-8e88-ba652b772c65 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:32.837326 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-0eafbd75-2d48-4688-8e88-ba652b772c65 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:32.838797 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-0eafbd75-2d48-4688-8e88-ba652b772c65 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1673 microversion: 2.20 time: 0.159796 Jul 28 18:22:32.839361 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 461/922] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:22:32 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:22:32.913883 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-2d709901-2ce2-44c3-9c75-c36eec4e73bf tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:22:32.914381 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-2d709901-2ce2-44c3-9c75-c36eec4e73bf tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: d729ee22-6dee-45a8-8460-14230cc47c0e] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:22:32.920479 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2d709901-2ce2-44c3-9c75-c36eec4e73bf tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:32.920934 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2d709901-2ce2-44c3-9c75-c36eec4e73bf tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:32.921734 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2d709901-2ce2-44c3-9c75-c36eec4e73bf tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:32.922175 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2d709901-2ce2-44c3-9c75-c36eec4e73bf tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:32.945718 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-2d709901-2ce2-44c3-9c75-c36eec4e73bf tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e/ips" status: 200 len: 146 microversion: 2.1 time: 0.035886 Jul 28 18:22:32.946463 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 462/923] 10.222.0.86 () {58 vars in 1248 bytes} [Thu Jul 28 18:22:32 2022] GET /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e/ips => generated 146 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:22:33.861989 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-c7428044-2c24-44f0-ae79-dba68ffd5afd tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:22:33.867869 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-c7428044-2c24-44f0-ae79-dba68ffd5afd tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:22:33.870909 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c7428044-2c24-44f0-ae79-dba68ffd5afd tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:33.871370 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c7428044-2c24-44f0-ae79-dba68ffd5afd tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:33.872184 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c7428044-2c24-44f0-ae79-dba68ffd5afd tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:33.872625 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c7428044-2c24-44f0-ae79-dba68ffd5afd tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:34.003995 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-c7428044-2c24-44f0-ae79-dba68ffd5afd tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:34.012014 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-c7428044-2c24-44f0-ae79-dba68ffd5afd tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:34.013579 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-c7428044-2c24-44f0-ae79-dba68ffd5afd tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:34.014725 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-c7428044-2c24-44f0-ae79-dba68ffd5afd tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1673 microversion: 2.20 time: 0.156784 Jul 28 18:22:34.015286 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 462/924] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:22:33 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:22:35.037427 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f5986739-a728-414e-b416-cf515a1c3a62 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:22:35.038046 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f5986739-a728-414e-b416-cf515a1c3a62 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:22:35.044901 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f5986739-a728-414e-b416-cf515a1c3a62 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:35.045388 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f5986739-a728-414e-b416-cf515a1c3a62 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:35.046561 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f5986739-a728-414e-b416-cf515a1c3a62 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:35.047007 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f5986739-a728-414e-b416-cf515a1c3a62 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:35.279644 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f5986739-a728-414e-b416-cf515a1c3a62 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:35.288065 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f5986739-a728-414e-b416-cf515a1c3a62 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:35.289619 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f5986739-a728-414e-b416-cf515a1c3a62 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:35.290796 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f5986739-a728-414e-b416-cf515a1c3a62 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1731 microversion: 2.20 time: 0.257322 Jul 28 18:22:35.291357 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 463/925] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:22:35 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1731 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:22:35.643208 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-55a35eac-0114-489b-99ce-6b2c34df19d2 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "de8b254d-55fd-4088-abac-cb204d167391"}} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:22:35.646223 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-55a35eac-0114-489b-99ce-6b2c34df19d2 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: d729ee22-6dee-45a8-8460-14230cc47c0e] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:22:35.652849 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-55a35eac-0114-489b-99ce-6b2c34df19d2 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:35.653325 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-55a35eac-0114-489b-99ce-6b2c34df19d2 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:35.654080 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-55a35eac-0114-489b-99ce-6b2c34df19d2 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:35.654513 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-55a35eac-0114-489b-99ce-6b2c34df19d2 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:36.314126 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-7a78df81-0f9c-460b-9635-4ef3e598e793 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:22:36.315483 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-7a78df81-0f9c-460b-9635-4ef3e598e793 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:22:36.322966 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7a78df81-0f9c-460b-9635-4ef3e598e793 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:36.323684 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7a78df81-0f9c-460b-9635-4ef3e598e793 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:36.324713 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7a78df81-0f9c-460b-9635-4ef3e598e793 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:36.325420 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7a78df81-0f9c-460b-9635-4ef3e598e793 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:36.364177 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:22:36.493541 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-55a35eac-0114-489b-99ce-6b2c34df19d2 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "POST /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.854026 Jul 28 18:22:36.494161 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 463/926] 10.222.0.86 () {60 vars in 1323 bytes} [Thu Jul 28 18:22:35 2022] POST /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e/os-volume_attachments => generated 194 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:22:36.502537 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-7a78df81-0f9c-460b-9635-4ef3e598e793 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:36.512840 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-7a78df81-0f9c-460b-9635-4ef3e598e793 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:36.514495 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-7a78df81-0f9c-460b-9635-4ef3e598e793 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:36.516240 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-7a78df81-0f9c-460b-9635-4ef3e598e793 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1731 microversion: 2.20 time: 0.206630 Jul 28 18:22:36.516879 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 464/927] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:22:36 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1731 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:22:37.541198 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-c114ec96-bdde-47a0-bc72-7837b6b2f534 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:22:37.542137 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-c114ec96-bdde-47a0-bc72-7837b6b2f534 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:22:37.549237 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c114ec96-bdde-47a0-bc72-7837b6b2f534 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:37.549697 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c114ec96-bdde-47a0-bc72-7837b6b2f534 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:37.550481 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c114ec96-bdde-47a0-bc72-7837b6b2f534 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:37.550933 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c114ec96-bdde-47a0-bc72-7837b6b2f534 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:37.688801 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-c114ec96-bdde-47a0-bc72-7837b6b2f534 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:37.697513 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-c114ec96-bdde-47a0-bc72-7837b6b2f534 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:37.699011 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-c114ec96-bdde-47a0-bc72-7837b6b2f534 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:37.700189 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-c114ec96-bdde-47a0-bc72-7837b6b2f534 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1731 microversion: 2.20 time: 0.164972 Jul 28 18:22:37.700738 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 464/928] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:22:37 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:22:38.726359 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-61e53a97-b455-4835-bdb7-3b9003d97f47 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:22:38.726988 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-61e53a97-b455-4835-bdb7-3b9003d97f47 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:22:38.734276 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-61e53a97-b455-4835-bdb7-3b9003d97f47 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:38.734728 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-61e53a97-b455-4835-bdb7-3b9003d97f47 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:38.735508 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-61e53a97-b455-4835-bdb7-3b9003d97f47 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:38.735949 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-61e53a97-b455-4835-bdb7-3b9003d97f47 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:38.873680 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-61e53a97-b455-4835-bdb7-3b9003d97f47 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:38.882889 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-61e53a97-b455-4835-bdb7-3b9003d97f47 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:38.884382 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-61e53a97-b455-4835-bdb7-3b9003d97f47 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:38.885575 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-61e53a97-b455-4835-bdb7-3b9003d97f47 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1731 microversion: 2.20 time: 0.164076 Jul 28 18:22:38.886159 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 465/929] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:22:38 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:22:39.909281 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-915c6962-20cf-4964-acae-a3d1dc40aa3f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:22:39.909816 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-915c6962-20cf-4964-acae-a3d1dc40aa3f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:22:39.916519 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-915c6962-20cf-4964-acae-a3d1dc40aa3f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:39.916995 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-915c6962-20cf-4964-acae-a3d1dc40aa3f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:39.917781 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-915c6962-20cf-4964-acae-a3d1dc40aa3f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:39.918254 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-915c6962-20cf-4964-acae-a3d1dc40aa3f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:40.056462 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-915c6962-20cf-4964-acae-a3d1dc40aa3f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:40.064687 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-915c6962-20cf-4964-acae-a3d1dc40aa3f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:40.066288 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-915c6962-20cf-4964-acae-a3d1dc40aa3f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:40.067798 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-915c6962-20cf-4964-acae-a3d1dc40aa3f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1731 microversion: 2.20 time: 0.162637 Jul 28 18:22:40.068358 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 465/930] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:22:39 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:22:41.091641 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-292730bb-7cc2-4096-8794-1dbf81aff130 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:22:41.092300 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-292730bb-7cc2-4096-8794-1dbf81aff130 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:22:41.098663 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-292730bb-7cc2-4096-8794-1dbf81aff130 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:41.099105 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-292730bb-7cc2-4096-8794-1dbf81aff130 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:41.099864 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-292730bb-7cc2-4096-8794-1dbf81aff130 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:41.100298 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-292730bb-7cc2-4096-8794-1dbf81aff130 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:41.237866 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-292730bb-7cc2-4096-8794-1dbf81aff130 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:41.247360 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-292730bb-7cc2-4096-8794-1dbf81aff130 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:41.249428 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-292730bb-7cc2-4096-8794-1dbf81aff130 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:41.250604 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-292730bb-7cc2-4096-8794-1dbf81aff130 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1731 microversion: 2.20 time: 0.163295 Jul 28 18:22:41.251498 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 466/931] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:22:41 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:22:41.891456 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-2be159ba-91a2-4aaa-a86b-df8eb139cb4b tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:22:41.892068 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-2be159ba-91a2-4aaa-a86b-df8eb139cb4b tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: 1b4d9d7f-8b12-4bfa-83a0-e55a8422d754] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:22:41.898884 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2be159ba-91a2-4aaa-a86b-df8eb139cb4b tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:41.899339 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2be159ba-91a2-4aaa-a86b-df8eb139cb4b tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:41.900106 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2be159ba-91a2-4aaa-a86b-df8eb139cb4b tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:41.900542 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2be159ba-91a2-4aaa-a86b-df8eb139cb4b tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:41.924543 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-2be159ba-91a2-4aaa-a86b-df8eb139cb4b tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/1b4d9d7f-8b12-4bfa-83a0-e55a8422d754/ips" status: 200 len: 149 microversion: 2.1 time: 0.037237 Jul 28 18:22:41.925151 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 466/932] 10.222.0.86 () {58 vars in 1248 bytes} [Thu Jul 28 18:22:41 2022] GET /compute/v2.1/servers/1b4d9d7f-8b12-4bfa-83a0-e55a8422d754/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:22:42.453592 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-873d79c6-4666-48fb-9934-375e10bb5c82 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:22:42.454218 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-873d79c6-4666-48fb-9934-375e10bb5c82 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:22:42.461803 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-873d79c6-4666-48fb-9934-375e10bb5c82 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:42.462742 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-873d79c6-4666-48fb-9934-375e10bb5c82 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:42.463803 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-873d79c6-4666-48fb-9934-375e10bb5c82 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:42.465574 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-873d79c6-4666-48fb-9934-375e10bb5c82 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:42.638089 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-873d79c6-4666-48fb-9934-375e10bb5c82 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:42.653251 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-873d79c6-4666-48fb-9934-375e10bb5c82 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:42.655352 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-873d79c6-4666-48fb-9934-375e10bb5c82 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:42.657788 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-873d79c6-4666-48fb-9934-375e10bb5c82 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1731 microversion: 2.20 time: 0.384612 Jul 28 18:22:42.657788 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 467/933] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:22:42 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1731 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:22:43.682619 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-fd93f647-14d8-4593-b530-fe44fe944208 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:22:43.683979 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-fd93f647-14d8-4593-b530-fe44fe944208 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:22:43.690871 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-fd93f647-14d8-4593-b530-fe44fe944208 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:43.691396 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-fd93f647-14d8-4593-b530-fe44fe944208 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:43.692272 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-fd93f647-14d8-4593-b530-fe44fe944208 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:43.692790 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-fd93f647-14d8-4593-b530-fe44fe944208 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:43.834678 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-fd93f647-14d8-4593-b530-fe44fe944208 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:43.843032 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-fd93f647-14d8-4593-b530-fe44fe944208 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:43.844456 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-fd93f647-14d8-4593-b530-fe44fe944208 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:43.845687 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-fd93f647-14d8-4593-b530-fe44fe944208 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1731 microversion: 2.20 time: 0.168538 Jul 28 18:22:43.846369 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 467/934] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:22:43 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:22:44.796297 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-eb2764ef-1913-461b-a1cb-78b43a2ea24f tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "511b7979-40bd-4b69-986c-fc90e6810395"}} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:22:44.798796 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-eb2764ef-1913-461b-a1cb-78b43a2ea24f tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: 1b4d9d7f-8b12-4bfa-83a0-e55a8422d754] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:22:44.805686 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-eb2764ef-1913-461b-a1cb-78b43a2ea24f tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:44.806154 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-eb2764ef-1913-461b-a1cb-78b43a2ea24f tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:44.806930 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-eb2764ef-1913-461b-a1cb-78b43a2ea24f tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:44.807370 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-eb2764ef-1913-461b-a1cb-78b43a2ea24f tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:44.868863 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-28b2ea03-7c57-4c8c-9533-0e39eb3d2d68 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:22:44.869346 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-28b2ea03-7c57-4c8c-9533-0e39eb3d2d68 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:22:44.875451 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-28b2ea03-7c57-4c8c-9533-0e39eb3d2d68 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:44.875842 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-28b2ea03-7c57-4c8c-9533-0e39eb3d2d68 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:44.876609 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-28b2ea03-7c57-4c8c-9533-0e39eb3d2d68 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:44.877077 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-28b2ea03-7c57-4c8c-9533-0e39eb3d2d68 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:45.286586 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-28b2ea03-7c57-4c8c-9533-0e39eb3d2d68 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:45.295393 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-28b2ea03-7c57-4c8c-9533-0e39eb3d2d68 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:45.297102 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-28b2ea03-7c57-4c8c-9533-0e39eb3d2d68 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:45.298332 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-28b2ea03-7c57-4c8c-9533-0e39eb3d2d68 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1731 microversion: 2.20 time: 0.433568 Jul 28 18:22:45.298931 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 468/935] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:22:44 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1731 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:22:46.322998 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-6e2823b3-421e-4a48-b85b-890ed7b966ce tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:22:46.323719 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-6e2823b3-421e-4a48-b85b-890ed7b966ce tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:22:46.330137 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-6e2823b3-421e-4a48-b85b-890ed7b966ce tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:46.330594 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-6e2823b3-421e-4a48-b85b-890ed7b966ce tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:46.331373 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-6e2823b3-421e-4a48-b85b-890ed7b966ce tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:46.331814 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-6e2823b3-421e-4a48-b85b-890ed7b966ce tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:46.495253 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-6e2823b3-421e-4a48-b85b-890ed7b966ce tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:46.505397 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-6e2823b3-421e-4a48-b85b-890ed7b966ce tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:46.507127 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-6e2823b3-421e-4a48-b85b-890ed7b966ce tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:46.508320 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-6e2823b3-421e-4a48-b85b-890ed7b966ce tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1731 microversion: 2.20 time: 0.189445 Jul 28 18:22:46.508874 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 469/936] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:22:46 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1731 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:22:47.531519 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-c6009917-f809-418f-b919-2ddefcce0a26 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:22:47.532248 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-c6009917-f809-418f-b919-2ddefcce0a26 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:22:47.538769 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c6009917-f809-418f-b919-2ddefcce0a26 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:47.539221 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c6009917-f809-418f-b919-2ddefcce0a26 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:47.539996 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c6009917-f809-418f-b919-2ddefcce0a26 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:47.540505 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c6009917-f809-418f-b919-2ddefcce0a26 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:47.676651 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-c6009917-f809-418f-b919-2ddefcce0a26 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:47.684660 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-c6009917-f809-418f-b919-2ddefcce0a26 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:47.686227 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-c6009917-f809-418f-b919-2ddefcce0a26 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:47.687556 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-c6009917-f809-418f-b919-2ddefcce0a26 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1731 microversion: 2.20 time: 0.159986 Jul 28 18:22:47.688143 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 470/937] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:22:47 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:22:48.710416 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-2295e967-5e3f-473a-acb7-d8c9f4ce645b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:22:48.711090 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-2295e967-5e3f-473a-acb7-d8c9f4ce645b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:22:48.717724 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2295e967-5e3f-473a-acb7-d8c9f4ce645b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:48.718167 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2295e967-5e3f-473a-acb7-d8c9f4ce645b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:48.718921 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2295e967-5e3f-473a-acb7-d8c9f4ce645b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:48.719354 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2295e967-5e3f-473a-acb7-d8c9f4ce645b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:48.847098 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-2295e967-5e3f-473a-acb7-d8c9f4ce645b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:48.855077 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-2295e967-5e3f-473a-acb7-d8c9f4ce645b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:48.856596 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-2295e967-5e3f-473a-acb7-d8c9f4ce645b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:48.857786 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-2295e967-5e3f-473a-acb7-d8c9f4ce645b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1731 microversion: 2.20 time: 0.151324 Jul 28 18:22:48.858346 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 471/938] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:22:48 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:22:49.881462 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-f9d4506f-1604-44d9-ae1a-d9d1a1be944f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:22:49.882132 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-f9d4506f-1604-44d9-ae1a-d9d1a1be944f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:22:49.888700 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f9d4506f-1604-44d9-ae1a-d9d1a1be944f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:49.889229 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f9d4506f-1604-44d9-ae1a-d9d1a1be944f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:49.890044 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f9d4506f-1604-44d9-ae1a-d9d1a1be944f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:49.890487 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f9d4506f-1604-44d9-ae1a-d9d1a1be944f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:50.016843 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-f9d4506f-1604-44d9-ae1a-d9d1a1be944f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:50.024840 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-f9d4506f-1604-44d9-ae1a-d9d1a1be944f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:50.026362 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-f9d4506f-1604-44d9-ae1a-d9d1a1be944f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:50.027504 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-f9d4506f-1604-44d9-ae1a-d9d1a1be944f tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1731 microversion: 2.20 time: 0.150139 Jul 28 18:22:50.028061 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 472/939] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:22:49 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:22:51.050665 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-87099af2-1056-4b1a-b87e-ff196d711854 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:22:51.051380 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-87099af2-1056-4b1a-b87e-ff196d711854 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:22:51.053701 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_api:SELECT=38 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:22:51.058427 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-87099af2-1056-4b1a-b87e-ff196d711854 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:51.064642 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-87099af2-1056-4b1a-b87e-ff196d711854 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:51.064642 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-87099af2-1056-4b1a-b87e-ff196d711854 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:51.064642 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-87099af2-1056-4b1a-b87e-ff196d711854 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:51.240023 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-87099af2-1056-4b1a-b87e-ff196d711854 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:51.248113 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-87099af2-1056-4b1a-b87e-ff196d711854 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:51.249672 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-87099af2-1056-4b1a-b87e-ff196d711854 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:51.250828 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-87099af2-1056-4b1a-b87e-ff196d711854 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1731 microversion: 2.20 time: 0.204125 Jul 28 18:22:51.251383 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 473/940] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:22:51 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1731 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:22:52.274031 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-04953b23-8bcf-4d08-87bf-5fff91a09bcf tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:22:52.274686 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-04953b23-8bcf-4d08-87bf-5fff91a09bcf tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:22:52.281249 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-04953b23-8bcf-4d08-87bf-5fff91a09bcf tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:52.281704 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-04953b23-8bcf-4d08-87bf-5fff91a09bcf tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:52.282466 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-04953b23-8bcf-4d08-87bf-5fff91a09bcf tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:52.282908 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-04953b23-8bcf-4d08-87bf-5fff91a09bcf tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:52.415203 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-04953b23-8bcf-4d08-87bf-5fff91a09bcf tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:52.424173 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-04953b23-8bcf-4d08-87bf-5fff91a09bcf tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:52.425588 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-04953b23-8bcf-4d08-87bf-5fff91a09bcf tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:52.426898 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-04953b23-8bcf-4d08-87bf-5fff91a09bcf tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1731 microversion: 2.20 time: 0.156897 Jul 28 18:22:52.427459 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 474/941] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:22:52 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:22:53.449611 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-66d5333f-8c30-467b-86ef-4fa36a5ae73c tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:22:53.450271 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-66d5333f-8c30-467b-86ef-4fa36a5ae73c tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:22:53.456854 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-66d5333f-8c30-467b-86ef-4fa36a5ae73c tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:53.457908 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-66d5333f-8c30-467b-86ef-4fa36a5ae73c tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:53.459033 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-66d5333f-8c30-467b-86ef-4fa36a5ae73c tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:53.459478 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-66d5333f-8c30-467b-86ef-4fa36a5ae73c tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:53.667922 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-66d5333f-8c30-467b-86ef-4fa36a5ae73c tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:53.675977 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-66d5333f-8c30-467b-86ef-4fa36a5ae73c tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:53.677796 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-66d5333f-8c30-467b-86ef-4fa36a5ae73c tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:53.678978 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-66d5333f-8c30-467b-86ef-4fa36a5ae73c tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1731 microversion: 2.20 time: 0.233597 Jul 28 18:22:53.679720 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 475/942] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:22:53 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1731 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:22:53.972855 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-eb2764ef-1913-461b-a1cb-78b43a2ea24f tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "POST /compute/v2.1/servers/1b4d9d7f-8b12-4bfa-83a0-e55a8422d754/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 9.180349 Jul 28 18:22:53.973725 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 468/943] 10.222.0.86 () {60 vars in 1323 bytes} [Thu Jul 28 18:22:44 2022] POST /compute/v2.1/servers/1b4d9d7f-8b12-4bfa-83a0-e55a8422d754/os-volume_attachments => generated 194 bytes in 9182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:22:54.702048 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-4fd25770-f581-4d54-a7cf-a04546ee1081 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:22:54.702591 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-4fd25770-f581-4d54-a7cf-a04546ee1081 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:22:54.709623 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-4fd25770-f581-4d54-a7cf-a04546ee1081 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:54.710072 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-4fd25770-f581-4d54-a7cf-a04546ee1081 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:54.710824 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-4fd25770-f581-4d54-a7cf-a04546ee1081 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:54.711258 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-4fd25770-f581-4d54-a7cf-a04546ee1081 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:54.841945 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-4fd25770-f581-4d54-a7cf-a04546ee1081 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:54.850873 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-4fd25770-f581-4d54-a7cf-a04546ee1081 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:54.852480 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-4fd25770-f581-4d54-a7cf-a04546ee1081 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:54.853773 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-4fd25770-f581-4d54-a7cf-a04546ee1081 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1731 microversion: 2.20 time: 0.155823 Jul 28 18:22:54.854454 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 476/944] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:22:54 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:22:55.874136 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:22:55.878373 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-9ff25a07-9470-4bb2-9eaa-2f7ea6fcc7e7 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:22:55.879064 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-9ff25a07-9470-4bb2-9eaa-2f7ea6fcc7e7 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:22:55.885624 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9ff25a07-9470-4bb2-9eaa-2f7ea6fcc7e7 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:55.887242 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9ff25a07-9470-4bb2-9eaa-2f7ea6fcc7e7 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:55.887242 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9ff25a07-9470-4bb2-9eaa-2f7ea6fcc7e7 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:55.887451 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9ff25a07-9470-4bb2-9eaa-2f7ea6fcc7e7 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:56.023492 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-9ff25a07-9470-4bb2-9eaa-2f7ea6fcc7e7 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:56.031348 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-9ff25a07-9470-4bb2-9eaa-2f7ea6fcc7e7 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:56.032863 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-9ff25a07-9470-4bb2-9eaa-2f7ea6fcc7e7 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:56.034126 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-9ff25a07-9470-4bb2-9eaa-2f7ea6fcc7e7 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1731 microversion: 2.20 time: 0.161444 Jul 28 18:22:56.034683 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 469/945] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:22:55 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:22:56.911580 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [req-a2251679-f98b-49d1-8584-49843445ca50 req-34ac69e2-9ebc-422a-9c60-0173e4af9201 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f14e236-1f43-4ff7-bf3d-ae1f6a084b82", "name": "network-vif-plugged", "status": "completed", "tag": "0069c542-1991-42af-bff0-348765fbb55f"}]} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:22:56.922002 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-a2251679-f98b-49d1-8584-49843445ca50 req-34ac69e2-9ebc-422a-9c60-0173e4af9201 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:56.922440 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-a2251679-f98b-49d1-8584-49843445ca50 req-34ac69e2-9ebc-422a-9c60-0173e4af9201 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:56.933180 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.compute.server_external_events [req-a2251679-f98b-49d1-8584-49843445ca50 req-34ac69e2-9ebc-422a-9c60-0173e4af9201 service nova] Creating event network-vif-plugged:0069c542-1991-42af-bff0-348765fbb55f for instance 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 on hv-cinder-84617 Jul 28 18:22:56.938171 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [req-a2251679-f98b-49d1-8584-49843445ca50 req-34ac69e2-9ebc-422a-9c60-0173e4af9201 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030348 Jul 28 18:22:56.938815 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 477/946] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:22:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:22:57.056664 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f97b4e46-8c88-4604-a178-713c9f97dc72 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:22:57.057450 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f97b4e46-8c88-4604-a178-713c9f97dc72 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:22:57.063948 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f97b4e46-8c88-4604-a178-713c9f97dc72 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:57.064396 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f97b4e46-8c88-4604-a178-713c9f97dc72 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:57.065199 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f97b4e46-8c88-4604-a178-713c9f97dc72 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:57.065633 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f97b4e46-8c88-4604-a178-713c9f97dc72 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:57.198812 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f97b4e46-8c88-4604-a178-713c9f97dc72 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:57.207184 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f97b4e46-8c88-4604-a178-713c9f97dc72 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:57.209305 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f97b4e46-8c88-4604-a178-713c9f97dc72 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:57.210470 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f97b4e46-8c88-4604-a178-713c9f97dc72 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1731 microversion: 2.20 time: 0.157712 Jul 28 18:22:57.211021 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 470/947] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:22:57 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:22:58.240895 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-c689e4e5-9ade-48cf-92b9-2fbe57dbe5b8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:22:58.241631 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-c689e4e5-9ade-48cf-92b9-2fbe57dbe5b8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:22:58.247788 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c689e4e5-9ade-48cf-92b9-2fbe57dbe5b8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:58.248245 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c689e4e5-9ade-48cf-92b9-2fbe57dbe5b8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:58.249035 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c689e4e5-9ade-48cf-92b9-2fbe57dbe5b8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:58.249483 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c689e4e5-9ade-48cf-92b9-2fbe57dbe5b8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:58.253568 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:22:58.382054 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-c689e4e5-9ade-48cf-92b9-2fbe57dbe5b8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:58.389957 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-c689e4e5-9ade-48cf-92b9-2fbe57dbe5b8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:58.391501 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-c689e4e5-9ade-48cf-92b9-2fbe57dbe5b8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:58.392658 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-c689e4e5-9ade-48cf-92b9-2fbe57dbe5b8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1731 microversion: 2.20 time: 0.157084 Jul 28 18:22:58.393252 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 478/948] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:22:58 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:22:59.415900 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5bc937aa-3a60-4398-a547-b00cfa661c3d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:22:59.416643 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-5bc937aa-3a60-4398-a547-b00cfa661c3d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:22:59.423437 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5bc937aa-3a60-4398-a547-b00cfa661c3d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:59.423970 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5bc937aa-3a60-4398-a547-b00cfa661c3d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:59.424752 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5bc937aa-3a60-4398-a547-b00cfa661c3d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:22:59.425226 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5bc937aa-3a60-4398-a547-b00cfa661c3d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:22:59.554532 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-5bc937aa-3a60-4398-a547-b00cfa661c3d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:59.562698 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-5bc937aa-3a60-4398-a547-b00cfa661c3d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:59.564309 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-5bc937aa-3a60-4398-a547-b00cfa661c3d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:22:59.565376 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-5bc937aa-3a60-4398-a547-b00cfa661c3d tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1731 microversion: 2.20 time: 0.153427 Jul 28 18:22:59.566171 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 471/949] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:22:59 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:23:00.589300 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-7706bdba-2e39-447c-9088-c24dd40521fb tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:23:00.590055 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-7706bdba-2e39-447c-9088-c24dd40521fb tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:23:00.597204 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-7706bdba-2e39-447c-9088-c24dd40521fb tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:00.597746 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-7706bdba-2e39-447c-9088-c24dd40521fb tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:00.598534 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-7706bdba-2e39-447c-9088-c24dd40521fb tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:00.598985 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-7706bdba-2e39-447c-9088-c24dd40521fb tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:00.734745 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-7706bdba-2e39-447c-9088-c24dd40521fb tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:23:00.743769 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-7706bdba-2e39-447c-9088-c24dd40521fb tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:23:00.745318 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-7706bdba-2e39-447c-9088-c24dd40521fb tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:23:00.746572 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-7706bdba-2e39-447c-9088-c24dd40521fb tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1731 microversion: 2.20 time: 0.162682 Jul 28 18:23:00.747136 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 479/950] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:23:00 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:23:01.771873 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-6e9f279d-f1cd-4735-a1aa-124a98b5c350 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:23:01.772604 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-6e9f279d-f1cd-4735-a1aa-124a98b5c350 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:23:01.779136 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6e9f279d-f1cd-4735-a1aa-124a98b5c350 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:01.779590 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6e9f279d-f1cd-4735-a1aa-124a98b5c350 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:01.780363 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6e9f279d-f1cd-4735-a1aa-124a98b5c350 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:01.780809 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6e9f279d-f1cd-4735-a1aa-124a98b5c350 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:01.912721 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-6e9f279d-f1cd-4735-a1aa-124a98b5c350 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:23:01.921168 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-6e9f279d-f1cd-4735-a1aa-124a98b5c350 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:23:01.922685 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-6e9f279d-f1cd-4735-a1aa-124a98b5c350 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:23:01.924474 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-6e9f279d-f1cd-4735-a1aa-124a98b5c350 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1718 microversion: 2.20 time: 0.156652 Jul 28 18:23:01.925060 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 472/951] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:23:01 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1718 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:23:02.067586 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-22291abe-1ee8-4da0-bdd3-458e769e341f tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:23:02.070316 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-22291abe-1ee8-4da0-bdd3-458e769e341f tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: d729ee22-6dee-45a8-8460-14230cc47c0e] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:23:02.076404 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-22291abe-1ee8-4da0-bdd3-458e769e341f tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:02.076851 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-22291abe-1ee8-4da0-bdd3-458e769e341f tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:02.077636 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-22291abe-1ee8-4da0-bdd3-458e769e341f tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:02.078072 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-22291abe-1ee8-4da0-bdd3-458e769e341f tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:02.106804 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-22291abe-1ee8-4da0-bdd3-458e769e341f tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043139 Jul 28 18:23:02.107353 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 480/952] 10.222.0.86 () {58 vars in 1302 bytes} [Thu Jul 28 18:23:02 2022] GET /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:23:02.118244 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3415ce46-d95d-4195-b109-076cc1290808 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:23:02.118736 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3415ce46-d95d-4195-b109-076cc1290808 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: d729ee22-6dee-45a8-8460-14230cc47c0e] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:23:02.124718 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3415ce46-d95d-4195-b109-076cc1290808 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:02.125279 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3415ce46-d95d-4195-b109-076cc1290808 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:02.126037 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3415ce46-d95d-4195-b109-076cc1290808 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:02.126481 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3415ce46-d95d-4195-b109-076cc1290808 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:02.154500 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-3415ce46-d95d-4195-b109-076cc1290808 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e/os-volume_attachments/de8b254d-55fd-4088-abac-cb204d167391" status: 200 len: 194 microversion: 2.1 time: 0.040719 Jul 28 18:23:02.155073 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 473/953] 10.222.0.86 () {58 vars in 1413 bytes} [Thu Jul 28 18:23:02 2022] GET /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e/os-volume_attachments/de8b254d-55fd-4088-abac-cb204d167391 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:23:03.832421 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-aeba672d-a7c6-47b5-8a5e-9199b78e3644 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f4359b81-b89e-4385-b426-8cf42dca81e3"}} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:23:03.836619 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-aeba672d-a7c6-47b5-8a5e-9199b78e3644 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: d729ee22-6dee-45a8-8460-14230cc47c0e] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:23:03.841924 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-aeba672d-a7c6-47b5-8a5e-9199b78e3644 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:03.842372 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-aeba672d-a7c6-47b5-8a5e-9199b78e3644 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:03.843164 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-aeba672d-a7c6-47b5-8a5e-9199b78e3644 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:03.843599 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-aeba672d-a7c6-47b5-8a5e-9199b78e3644 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:04.584611 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-aeba672d-a7c6-47b5-8a5e-9199b78e3644 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "POST /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.755581 Jul 28 18:23:04.585283 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 481/954] 10.222.0.86 () {60 vars in 1323 bytes} [Thu Jul 28 18:23:03 2022] POST /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e/os-volume_attachments => generated 194 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:23:08.922168 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-1d7d51d1-0db3-449d-9362-e15a6b588079 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Action: 'create', calling method: .version_select at 0x7f6fe6c19940>, body: {"keypair": {"name": "tempest-keypair-211244545", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMw+cQUGUgeflRmaYc+4bGrVnr3n8YqU1X4PsZSva1ptGX0gdXIRXvWTZ2dNZ3hhZwol3AcDLlCwKdoPq4h2CXhu6cswUJUKBAYCarSZdRXA76z0h5nMCtCexaV6ZZLdGg=="}} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:23:08.938368 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.quota [None req-1d7d51d1-0db3-449d-9362-e15a6b588079 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Getting quotas for project 104313ce72c94ea68c8cd3ee7f0cab2e. Resources: {'key_pairs'} {{(pid=118453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 18:23:08.942271 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.quota [None req-1d7d51d1-0db3-449d-9362-e15a6b588079 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Getting quotas for user e2b1f1c4bb2747e0845cdc2991e53b09 and project 104313ce72c94ea68c8cd3ee7f0cab2e. Resources: {'key_pairs'} {{(pid=118453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 18:23:08.954332 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1d7d51d1-0db3-449d-9362-e15a6b588079 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [7a25c615-497b-41dc-91f1-137b33764f9e] AMQP server on 10.222.0.86:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 28 18:23:09.962360 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO oslo.messaging._drivers.impl_rabbit [None req-1d7d51d1-0db3-449d-9362-e15a6b588079 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [7a25c615-497b-41dc-91f1-137b33764f9e] Reconnected to AMQP server on 10.222.0.86:5672 via [amqp] client with port 53428. Jul 28 18:23:10.031567 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-1d7d51d1-0db3-449d-9362-e15a6b588079 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.113197 Jul 28 18:23:10.032186 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 474/955] 10.222.0.86 () {60 vars in 1159 bytes} [Thu Jul 28 18:23:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:23:12.352042 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-a705cf7d-9320-4196-b2d2-ac4f9c935d14 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-68561531", "imageRef": "61912422-61cd-4ced-a573-85ee305e010f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "44a25a1e-08cb-4158-9e81-b93066923b4d"}], "security_groups": [{"name": "tempest-securitygroup--238124517"}], "key_name": "tempest-keypair-211244545", "user_data": "}} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:23:12.459742 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.network.neutron [None req-a705cf7d-9320-4196-b2d2-ac4f9c935d14 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] validate_networks() for [('44a25a1e-08cb-4158-9e81-b93066923b4d', None, None, None, None, None)] {{(pid=118454) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 18:23:12.887112 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.virt.hardware [None req-a705cf7d-9320-4196-b2d2-ac4f9c935d14 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Flavor limits 0:0:0 {{(pid=118454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 18:23:12.887566 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.virt.hardware [None req-a705cf7d-9320-4196-b2d2-ac4f9c935d14 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Image limits 0:0:0 {{(pid=118454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 18:23:12.888047 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.virt.hardware [None req-a705cf7d-9320-4196-b2d2-ac4f9c935d14 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Flavor pref 0:0:0 {{(pid=118454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 18:23:12.888489 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.virt.hardware [None req-a705cf7d-9320-4196-b2d2-ac4f9c935d14 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Image pref 0:0:0 {{(pid=118454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 18:23:12.888901 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.virt.hardware [None req-a705cf7d-9320-4196-b2d2-ac4f9c935d14 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 18:23:12.897833 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a705cf7d-9320-4196-b2d2-ac4f9c935d14 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:12.898285 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a705cf7d-9320-4196-b2d2-ac4f9c935d14 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:12.899081 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a705cf7d-9320-4196-b2d2-ac4f9c935d14 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:12.899515 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a705cf7d-9320-4196-b2d2-ac4f9c935d14 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:12.916269 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.quota [None req-a705cf7d-9320-4196-b2d2-ac4f9c935d14 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Getting quotas for project 104313ce72c94ea68c8cd3ee7f0cab2e. Resources: {'cores', 'ram', 'instances'} {{(pid=118454) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 18:23:12.920227 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.quota [None req-a705cf7d-9320-4196-b2d2-ac4f9c935d14 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Getting quotas for user e2b1f1c4bb2747e0845cdc2991e53b09 and project 104313ce72c94ea68c8cd3ee7f0cab2e. Resources: {'cores', 'ram', 'instances'} {{(pid=118454) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 18:23:12.931701 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-a705cf7d-9320-4196-b2d2-ac4f9c935d14 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Going to run 1 instances... {{(pid=118454) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 18:23:12.934120 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-a705cf7d-9320-4196-b2d2-ac4f9c935d14 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: f7a41dc5-d258-475a-a1c1-9aad0723d5cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='61912422-61cd-4ced-a573-85ee305e010f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118454) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 18:23:13.062290 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-a705cf7d-9320-4196-b2d2-ac4f9c935d14 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.715476 Jul 28 18:23:13.063142 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 482/956] 10.222.0.86 () {60 vars in 1147 bytes} [Thu Jul 28 18:23:12 2022] POST /compute/v2.1/servers => generated 401 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 18:23:13.071462 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:23:13.076004 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-2f30e319-6fc0-4dbc-a1a9-267dead94dd0 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:23:13.076624 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-2f30e319-6fc0-4dbc-a1a9-267dead94dd0 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: f7a41dc5-d258-475a-a1c1-9aad0723d5cb] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:23:13.137594 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-2f30e319-6fc0-4dbc-a1a9-267dead94dd0 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:23:13.144088 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-2f30e319-6fc0-4dbc-a1a9-267dead94dd0 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb" status: 200 len: 1239 microversion: 2.1 time: 0.073985 Jul 28 18:23:13.145471 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 475/957] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:23:13 2022] GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb => generated 1239 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:23:14.166266 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-e3c7bcab-ed27-479e-b851-592ccdd85c16 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:23:14.166911 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-e3c7bcab-ed27-479e-b851-592ccdd85c16 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: f7a41dc5-d258-475a-a1c1-9aad0723d5cb] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:23:14.173316 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e3c7bcab-ed27-479e-b851-592ccdd85c16 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:14.173772 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e3c7bcab-ed27-479e-b851-592ccdd85c16 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:14.174541 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e3c7bcab-ed27-479e-b851-592ccdd85c16 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:14.174988 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e3c7bcab-ed27-479e-b851-592ccdd85c16 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:14.236519 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-e3c7bcab-ed27-479e-b851-592ccdd85c16 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:23:14.244055 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-e3c7bcab-ed27-479e-b851-592ccdd85c16 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb" status: 200 len: 1243 microversion: 2.1 time: 0.082960 Jul 28 18:23:14.244603 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 483/958] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:23:14 2022] GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb => generated 1243 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:23:15.264352 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-04cc996e-c577-470d-ad94-279fb40c0a8b tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:23:15.264982 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-04cc996e-c577-470d-ad94-279fb40c0a8b tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: f7a41dc5-d258-475a-a1c1-9aad0723d5cb] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:23:15.271447 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-04cc996e-c577-470d-ad94-279fb40c0a8b tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:15.271902 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-04cc996e-c577-470d-ad94-279fb40c0a8b tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:15.272660 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-04cc996e-c577-470d-ad94-279fb40c0a8b tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:15.273133 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-04cc996e-c577-470d-ad94-279fb40c0a8b tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:15.335092 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-04cc996e-c577-470d-ad94-279fb40c0a8b tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:23:15.342815 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-04cc996e-c577-470d-ad94-279fb40c0a8b tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb" status: 200 len: 1291 microversion: 2.1 time: 0.082666 Jul 28 18:23:15.343374 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 476/959] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:23:15 2022] GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb => generated 1291 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:23:16.363955 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-61f2f46b-d920-44dc-abff-d6db23d345f6 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:23:16.365291 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-61f2f46b-d920-44dc-abff-d6db23d345f6 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: f7a41dc5-d258-475a-a1c1-9aad0723d5cb] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:23:16.372400 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-61f2f46b-d920-44dc-abff-d6db23d345f6 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:16.373110 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-61f2f46b-d920-44dc-abff-d6db23d345f6 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:16.373934 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-61f2f46b-d920-44dc-abff-d6db23d345f6 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:16.377607 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-61f2f46b-d920-44dc-abff-d6db23d345f6 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:16.452942 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-61f2f46b-d920-44dc-abff-d6db23d345f6 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:23:16.461079 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-61f2f46b-d920-44dc-abff-d6db23d345f6 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb" status: 200 len: 1299 microversion: 2.1 time: 0.100945 Jul 28 18:23:16.461570 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 484/960] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:23:16 2022] GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb => generated 1299 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:23:17.399405 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-81329e9a-ef1a-4b97-8e15-b52d981bd855 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:23:17.401605 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-81329e9a-ef1a-4b97-8e15-b52d981bd855 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: d729ee22-6dee-45a8-8460-14230cc47c0e] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:23:17.408033 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-81329e9a-ef1a-4b97-8e15-b52d981bd855 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:17.408486 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-81329e9a-ef1a-4b97-8e15-b52d981bd855 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:17.409294 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-81329e9a-ef1a-4b97-8e15-b52d981bd855 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:17.409738 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-81329e9a-ef1a-4b97-8e15-b52d981bd855 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:17.440992 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-81329e9a-ef1a-4b97-8e15-b52d981bd855 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045968 Jul 28 18:23:17.441871 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 477/961] 10.222.0.86 () {58 vars in 1302 bytes} [Thu Jul 28 18:23:17 2022] GET /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:23:17.487583 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-14214449-4824-46a4-8483-3430a49b6bc7 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:23:17.488197 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-14214449-4824-46a4-8483-3430a49b6bc7 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: f7a41dc5-d258-475a-a1c1-9aad0723d5cb] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:23:17.495520 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-14214449-4824-46a4-8483-3430a49b6bc7 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:17.495979 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-14214449-4824-46a4-8483-3430a49b6bc7 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:17.496775 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-14214449-4824-46a4-8483-3430a49b6bc7 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:17.497230 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-14214449-4824-46a4-8483-3430a49b6bc7 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:17.580250 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-22956c2a-5e49-4c24-ba54-18a5fb45b1bc tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:23:17.580747 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-22956c2a-5e49-4c24-ba54-18a5fb45b1bc tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: d729ee22-6dee-45a8-8460-14230cc47c0e] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:23:17.587844 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-22956c2a-5e49-4c24-ba54-18a5fb45b1bc tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:17.591210 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-22956c2a-5e49-4c24-ba54-18a5fb45b1bc tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:17.591210 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-22956c2a-5e49-4c24-ba54-18a5fb45b1bc tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:17.591210 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-22956c2a-5e49-4c24-ba54-18a5fb45b1bc tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:17.617750 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-22956c2a-5e49-4c24-ba54-18a5fb45b1bc tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e/os-volume_attachments/de8b254d-55fd-4088-abac-cb204d167391" status: 200 len: 194 microversion: 2.1 time: 0.041559 Jul 28 18:23:17.624951 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 478/962] 10.222.0.86 () {58 vars in 1413 bytes} [Thu Jul 28 18:23:17 2022] GET /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e/os-volume_attachments/de8b254d-55fd-4088-abac-cb204d167391 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 18:23:17.628374 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ca506e70-3602-46b4-8f28-7681915ef1ac tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:23:17.628868 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ca506e70-3602-46b4-8f28-7681915ef1ac tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: d729ee22-6dee-45a8-8460-14230cc47c0e] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:23:17.632430 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-14214449-4824-46a4-8483-3430a49b6bc7 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:23:17.635343 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ca506e70-3602-46b4-8f28-7681915ef1ac tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:17.635795 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ca506e70-3602-46b4-8f28-7681915ef1ac tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:17.636565 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ca506e70-3602-46b4-8f28-7681915ef1ac tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:17.637022 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ca506e70-3602-46b4-8f28-7681915ef1ac tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:17.640042 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-14214449-4824-46a4-8483-3430a49b6bc7 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb" status: 200 len: 1364 microversion: 2.1 time: 0.156913 Jul 28 18:23:17.640602 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 485/963] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:23:17 2022] GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:23:17.724328 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.objects.instance [None req-ca506e70-3602-46b4-8f28-7681915ef1ac tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lazy-loading 'services' on Instance uuid d729ee22-6dee-45a8-8460-14230cc47c0e {{(pid=118453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:23:17.945859 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ca506e70-3602-46b4-8f28-7681915ef1ac tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "DELETE /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e/os-volume_attachments/de8b254d-55fd-4088-abac-cb204d167391" status: 202 len: 0 microversion: 2.1 time: 0.320982 Jul 28 18:23:17.946512 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 479/964] 10.222.0.86 () {58 vars in 1416 bytes} [Thu Jul 28 18:23:17 2022] DELETE /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e/os-volume_attachments/de8b254d-55fd-4088-abac-cb204d167391 => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 18:23:18.080199 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [req-7b102fb5-ce56-41e8-a7dd-7121c38d6d95 req-a023029f-be6f-4855-85b2-1c94e19ae0e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7a41dc5-d258-475a-a1c1-9aad0723d5cb", "tag": "aa7258bd-d420-41dc-a491-75aceff4ed8e"}]} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:23:18.096005 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-7b102fb5-ce56-41e8-a7dd-7121c38d6d95 req-a023029f-be6f-4855-85b2-1c94e19ae0e3 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:18.096005 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-7b102fb5-ce56-41e8-a7dd-7121c38d6d95 req-a023029f-be6f-4855-85b2-1c94e19ae0e3 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:18.106756 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.compute.server_external_events [req-7b102fb5-ce56-41e8-a7dd-7121c38d6d95 req-a023029f-be6f-4855-85b2-1c94e19ae0e3 service nova] Creating event network-changed:aa7258bd-d420-41dc-a491-75aceff4ed8e for instance f7a41dc5-d258-475a-a1c1-9aad0723d5cb on hv-cinder-84617 Jul 28 18:23:18.111683 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [req-7b102fb5-ce56-41e8-a7dd-7121c38d6d95 req-a023029f-be6f-4855-85b2-1c94e19ae0e3 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101479 Jul 28 18:23:18.113110 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 486/965] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:23:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 18:23:18.663733 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-10f4277d-1950-4f16-bd36-2093fc7591e4 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:23:18.664722 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-10f4277d-1950-4f16-bd36-2093fc7591e4 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: f7a41dc5-d258-475a-a1c1-9aad0723d5cb] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:23:18.671425 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-10f4277d-1950-4f16-bd36-2093fc7591e4 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:18.673244 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-10f4277d-1950-4f16-bd36-2093fc7591e4 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:18.673244 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-10f4277d-1950-4f16-bd36-2093fc7591e4 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:18.673244 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-10f4277d-1950-4f16-bd36-2093fc7591e4 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:18.800071 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-10f4277d-1950-4f16-bd36-2093fc7591e4 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:23:18.808009 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-10f4277d-1950-4f16-bd36-2093fc7591e4 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb" status: 200 len: 1364 microversion: 2.1 time: 0.150151 Jul 28 18:23:18.808566 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 480/966] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:23:18 2022] GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:23:19.830412 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-58344a92-4e21-4f2b-aa34-a657d1d1a0b3 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:23:19.831116 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-58344a92-4e21-4f2b-aa34-a657d1d1a0b3 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: f7a41dc5-d258-475a-a1c1-9aad0723d5cb] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:23:19.837722 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-58344a92-4e21-4f2b-aa34-a657d1d1a0b3 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:19.838169 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-58344a92-4e21-4f2b-aa34-a657d1d1a0b3 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:19.838940 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-58344a92-4e21-4f2b-aa34-a657d1d1a0b3 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:19.839381 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-58344a92-4e21-4f2b-aa34-a657d1d1a0b3 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:19.967654 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-58344a92-4e21-4f2b-aa34-a657d1d1a0b3 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:23:19.975577 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-58344a92-4e21-4f2b-aa34-a657d1d1a0b3 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb" status: 200 len: 1364 microversion: 2.1 time: 0.149815 Jul 28 18:23:19.976143 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 487/967] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:23:19 2022] GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:23:20.130475 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-7d0884e7-1d4c-426f-9745-880e633f5b58 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:23:20.131020 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-7d0884e7-1d4c-426f-9745-880e633f5b58 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: d729ee22-6dee-45a8-8460-14230cc47c0e] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:23:20.137490 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7d0884e7-1d4c-426f-9745-880e633f5b58 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:20.138069 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7d0884e7-1d4c-426f-9745-880e633f5b58 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:20.138835 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7d0884e7-1d4c-426f-9745-880e633f5b58 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:20.139273 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7d0884e7-1d4c-426f-9745-880e633f5b58 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:20.167684 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-7d0884e7-1d4c-426f-9745-880e633f5b58 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e/os-volume_attachments/f4359b81-b89e-4385-b426-8cf42dca81e3" status: 200 len: 194 microversion: 2.1 time: 0.041284 Jul 28 18:23:20.168247 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 481/968] 10.222.0.86 () {58 vars in 1413 bytes} [Thu Jul 28 18:23:20 2022] GET /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e/os-volume_attachments/f4359b81-b89e-4385-b426-8cf42dca81e3 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:23:20.178627 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-9f3bcf2c-68ac-47f2-87a3-922a1e12074c tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:23:20.182349 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-9f3bcf2c-68ac-47f2-87a3-922a1e12074c tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: d729ee22-6dee-45a8-8460-14230cc47c0e] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:23:20.185191 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-9f3bcf2c-68ac-47f2-87a3-922a1e12074c tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:20.185636 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-9f3bcf2c-68ac-47f2-87a3-922a1e12074c tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:20.186391 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-9f3bcf2c-68ac-47f2-87a3-922a1e12074c tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:20.186831 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-9f3bcf2c-68ac-47f2-87a3-922a1e12074c tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:20.265957 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.objects.instance [None req-9f3bcf2c-68ac-47f2-87a3-922a1e12074c tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lazy-loading 'services' on Instance uuid d729ee22-6dee-45a8-8460-14230cc47c0e {{(pid=118454) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:23:20.510657 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-9f3bcf2c-68ac-47f2-87a3-922a1e12074c tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "DELETE /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e/os-volume_attachments/f4359b81-b89e-4385-b426-8cf42dca81e3" status: 202 len: 0 microversion: 2.1 time: 0.335858 Jul 28 18:23:20.511247 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 488/969] 10.222.0.86 () {58 vars in 1416 bytes} [Thu Jul 28 18:23:20 2022] DELETE /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e/os-volume_attachments/f4359b81-b89e-4385-b426-8cf42dca81e3 => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 18:23:20.995871 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-66fbe169-c746-4aab-8588-3c241f99f666 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:23:20.996485 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-66fbe169-c746-4aab-8588-3c241f99f666 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: f7a41dc5-d258-475a-a1c1-9aad0723d5cb] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:23:21.002503 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-66fbe169-c746-4aab-8588-3c241f99f666 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:21.002951 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-66fbe169-c746-4aab-8588-3c241f99f666 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:21.003708 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-66fbe169-c746-4aab-8588-3c241f99f666 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:21.004144 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-66fbe169-c746-4aab-8588-3c241f99f666 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:21.134528 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-66fbe169-c746-4aab-8588-3c241f99f666 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:23:21.142470 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-66fbe169-c746-4aab-8588-3c241f99f666 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb" status: 200 len: 1364 microversion: 2.1 time: 0.150494 Jul 28 18:23:21.143035 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 482/970] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:23:20 2022] GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:23:22.164392 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-ecd370e8-1162-49f9-b4ef-ae4ab7c40e7a tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:23:22.165127 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-ecd370e8-1162-49f9-b4ef-ae4ab7c40e7a tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: f7a41dc5-d258-475a-a1c1-9aad0723d5cb] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:23:22.167069 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:23:22.172044 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ecd370e8-1162-49f9-b4ef-ae4ab7c40e7a tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:22.182670 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ecd370e8-1162-49f9-b4ef-ae4ab7c40e7a tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:22.182670 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ecd370e8-1162-49f9-b4ef-ae4ab7c40e7a tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:22.182670 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ecd370e8-1162-49f9-b4ef-ae4ab7c40e7a tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:22.301368 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-ecd370e8-1162-49f9-b4ef-ae4ab7c40e7a tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:23:22.309113 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-ecd370e8-1162-49f9-b4ef-ae4ab7c40e7a tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb" status: 200 len: 1364 microversion: 2.1 time: 0.149493 Jul 28 18:23:22.309676 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 489/971] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:23:22 2022] GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:23:23.333080 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-6697a6a1-b5ec-40cd-9f7a-b811cc3a825b tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:23:23.333766 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-6697a6a1-b5ec-40cd-9f7a-b811cc3a825b tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: f7a41dc5-d258-475a-a1c1-9aad0723d5cb] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:23:23.336520 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell0:SELECT=6 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:23:23.342033 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6697a6a1-b5ec-40cd-9f7a-b811cc3a825b tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:23.342486 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6697a6a1-b5ec-40cd-9f7a-b811cc3a825b tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:23.343267 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6697a6a1-b5ec-40cd-9f7a-b811cc3a825b tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:23.343869 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6697a6a1-b5ec-40cd-9f7a-b811cc3a825b tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:23.486450 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-6697a6a1-b5ec-40cd-9f7a-b811cc3a825b tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:23:23.494674 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-6697a6a1-b5ec-40cd-9f7a-b811cc3a825b tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb" status: 200 len: 1364 microversion: 2.1 time: 0.166250 Jul 28 18:23:23.495249 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 483/972] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:23:23 2022] GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:23:23.794784 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-70034d61-cc0d-436b-8bf1-4ff77494b4a1 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:23:23.797243 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-70034d61-cc0d-436b-8bf1-4ff77494b4a1 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: d729ee22-6dee-45a8-8460-14230cc47c0e] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:23:23.799078 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell0:SELECT=2 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:23:23.799776 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell0:SELECT=6 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:23:23.805690 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-70034d61-cc0d-436b-8bf1-4ff77494b4a1 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:23.806144 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-70034d61-cc0d-436b-8bf1-4ff77494b4a1 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:23.806986 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-70034d61-cc0d-436b-8bf1-4ff77494b4a1 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:23.807432 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-70034d61-cc0d-436b-8bf1-4ff77494b4a1 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:23.837551 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-70034d61-cc0d-436b-8bf1-4ff77494b4a1 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046674 Jul 28 18:23:23.838108 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 490/973] 10.222.0.86 () {58 vars in 1302 bytes} [Thu Jul 28 18:23:23 2022] GET /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 18:23:23.955339 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-842bc5c2-5b5b-454d-b789-638eea492660 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:23:23.955339 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-842bc5c2-5b5b-454d-b789-638eea492660 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: d729ee22-6dee-45a8-8460-14230cc47c0e] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:23:23.958118 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-842bc5c2-5b5b-454d-b789-638eea492660 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:23.958564 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-842bc5c2-5b5b-454d-b789-638eea492660 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:23.959322 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-842bc5c2-5b5b-454d-b789-638eea492660 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:23.959813 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-842bc5c2-5b5b-454d-b789-638eea492660 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:23.988721 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-842bc5c2-5b5b-454d-b789-638eea492660 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042878 Jul 28 18:23:23.989330 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 484/974] 10.222.0.86 () {58 vars in 1302 bytes} [Thu Jul 28 18:23:23 2022] GET /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 18:23:24.058809 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-cef51a81-3987-42c4-ae5a-5ea98d5c2f4d tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:23:24.059302 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-cef51a81-3987-42c4-ae5a-5ea98d5c2f4d tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: d729ee22-6dee-45a8-8460-14230cc47c0e] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:23:24.065798 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-cef51a81-3987-42c4-ae5a-5ea98d5c2f4d tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:24.066259 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-cef51a81-3987-42c4-ae5a-5ea98d5c2f4d tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:24.067031 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-cef51a81-3987-42c4-ae5a-5ea98d5c2f4d tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:24.067637 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-cef51a81-3987-42c4-ae5a-5ea98d5c2f4d tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:24.093053 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-cef51a81-3987-42c4-ae5a-5ea98d5c2f4d tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: d729ee22-6dee-45a8-8460-14230cc47c0e] Going to try to terminate instance {{(pid=118454) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 18:23:24.328551 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-cef51a81-3987-42c4-ae5a-5ea98d5c2f4d tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "DELETE /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e" status: 204 len: 0 microversion: 2.1 time: 0.273634 Jul 28 18:23:24.329203 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 491/975] 10.222.0.86 () {58 vars in 1239 bytes} [Thu Jul 28 18:23:24 2022] DELETE /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 18:23:24.337748 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-fbaf9ce3-630a-4d53-9784-1c02d155af2a tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:23:24.338361 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-fbaf9ce3-630a-4d53-9784-1c02d155af2a tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: d729ee22-6dee-45a8-8460-14230cc47c0e] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:23:24.344984 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fbaf9ce3-630a-4d53-9784-1c02d155af2a tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:24.345458 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fbaf9ce3-630a-4d53-9784-1c02d155af2a tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:24.346247 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fbaf9ce3-630a-4d53-9784-1c02d155af2a tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:24.346693 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fbaf9ce3-630a-4d53-9784-1c02d155af2a tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:24.517202 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-618e4832-a4c6-4d91-a6ea-f478c47cfb11 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:23:24.518260 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-618e4832-a4c6-4d91-a6ea-f478c47cfb11 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: f7a41dc5-d258-475a-a1c1-9aad0723d5cb] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:23:24.524824 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-618e4832-a4c6-4d91-a6ea-f478c47cfb11 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:24.526073 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-618e4832-a4c6-4d91-a6ea-f478c47cfb11 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:24.526073 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-618e4832-a4c6-4d91-a6ea-f478c47cfb11 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:24.526475 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-618e4832-a4c6-4d91-a6ea-f478c47cfb11 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:24.546482 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:23:24.687400 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-fbaf9ce3-630a-4d53-9784-1c02d155af2a tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:23:24.696435 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-fbaf9ce3-630a-4d53-9784-1c02d155af2a tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e" status: 200 len: 1675 microversion: 2.1 time: 0.362728 Jul 28 18:23:24.710961 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 485/976] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:23:24 2022] GET /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e => generated 1675 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:23:24.716178 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-618e4832-a4c6-4d91-a6ea-f478c47cfb11 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:23:24.723904 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-618e4832-a4c6-4d91-a6ea-f478c47cfb11 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb" status: 200 len: 1364 microversion: 2.1 time: 0.211812 Jul 28 18:23:24.725386 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 492/977] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:23:24 2022] GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb => generated 1364 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:23:25.084221 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-106d0c78-f703-49f6-929d-779512eaa0e3 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:23:25.084775 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-106d0c78-f703-49f6-929d-779512eaa0e3 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:23:25.086328 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [req-00d2e99f-5060-427c-b83b-bf44230fd50c req-a61c5ea0-a626-470a-b74b-529afb919f0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb0a115f-17bf-4501-af27-0802f70ac213", "tag": "5415e2f4-0f86-4921-bdc7-f0bf38bcd3e3"}]} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:23:25.091368 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-106d0c78-f703-49f6-929d-779512eaa0e3 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:25.092270 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-106d0c78-f703-49f6-929d-779512eaa0e3 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:25.093151 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-106d0c78-f703-49f6-929d-779512eaa0e3 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:25.093743 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-106d0c78-f703-49f6-929d-779512eaa0e3 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:25.096374 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-00d2e99f-5060-427c-b83b-bf44230fd50c req-a61c5ea0-a626-470a-b74b-529afb919f0f service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:25.096819 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-00d2e99f-5060-427c-b83b-bf44230fd50c req-a61c5ea0-a626-470a-b74b-529afb919f0f service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:25.108952 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.compute.server_external_events [req-00d2e99f-5060-427c-b83b-bf44230fd50c req-a61c5ea0-a626-470a-b74b-529afb919f0f service nova] Creating event network-changed:5415e2f4-0f86-4921-bdc7-f0bf38bcd3e3 for instance eb0a115f-17bf-4501-af27-0802f70ac213 on hv-cinder-84617 Jul 28 18:23:25.114601 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [req-00d2e99f-5060-427c-b83b-bf44230fd50c req-a61c5ea0-a626-470a-b74b-529afb919f0f service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031941 Jul 28 18:23:25.115982 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 493/978] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:23:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 18:23:25.123843 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-106d0c78-f703-49f6-929d-779512eaa0e3 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Going to try to terminate instance {{(pid=118453) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 18:23:25.252046 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [req-889ee5e1-b215-49d4-ac11-babc76d841cc req-cc8163dc-1c41-47f2-ba72-6557587cd3ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7a41dc5-d258-475a-a1c1-9aad0723d5cb", "name": "network-vif-plugged", "status": "completed", "tag": "aa7258bd-d420-41dc-a491-75aceff4ed8e"}]} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:23:25.262066 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-889ee5e1-b215-49d4-ac11-babc76d841cc req-cc8163dc-1c41-47f2-ba72-6557587cd3ce service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:25.262517 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-889ee5e1-b215-49d4-ac11-babc76d841cc req-cc8163dc-1c41-47f2-ba72-6557587cd3ce service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:25.273179 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.compute.server_external_events [req-889ee5e1-b215-49d4-ac11-babc76d841cc req-cc8163dc-1c41-47f2-ba72-6557587cd3ce service nova] Creating event network-vif-plugged:aa7258bd-d420-41dc-a491-75aceff4ed8e for instance f7a41dc5-d258-475a-a1c1-9aad0723d5cb on hv-cinder-84617 Jul 28 18:23:25.278046 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [req-889ee5e1-b215-49d4-ac11-babc76d841cc req-cc8163dc-1c41-47f2-ba72-6557587cd3ce service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098369 Jul 28 18:23:25.278638 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 494/979] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:23:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 18:23:25.385420 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-106d0c78-f703-49f6-929d-779512eaa0e3 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "DELETE /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213" status: 204 len: 0 microversion: 2.1 time: 0.304602 Jul 28 18:23:25.385982 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 486/980] 10.222.0.86 () {58 vars in 1239 bytes} [Thu Jul 28 18:23:25 2022] DELETE /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 18:23:25.395177 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-212fe0b8-b8e1-415a-a282-02682a8148af tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:23:25.396644 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-212fe0b8-b8e1-415a-a282-02682a8148af tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:23:25.403147 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-212fe0b8-b8e1-415a-a282-02682a8148af tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:25.403616 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-212fe0b8-b8e1-415a-a282-02682a8148af tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:25.404381 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-212fe0b8-b8e1-415a-a282-02682a8148af tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:25.404824 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-212fe0b8-b8e1-415a-a282-02682a8148af tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:25.545484 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-212fe0b8-b8e1-415a-a282-02682a8148af tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba025a383c433b900a3f4ae64959b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf347b1959b247bcbe003ac3662cb239', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:23:25.554409 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-212fe0b8-b8e1-415a-a282-02682a8148af tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213" status: 200 len: 1568 microversion: 2.1 time: 0.163145 Jul 28 18:23:25.555414 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 495/981] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:23:25 2022] GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:23:25.719589 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-fb19495e-1967-48ce-bad0-0ca1d2d68117 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:23:25.720367 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-fb19495e-1967-48ce-bad0-0ca1d2d68117 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: d729ee22-6dee-45a8-8460-14230cc47c0e] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:23:25.726723 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fb19495e-1967-48ce-bad0-0ca1d2d68117 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:25.727178 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fb19495e-1967-48ce-bad0-0ca1d2d68117 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:25.727961 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fb19495e-1967-48ce-bad0-0ca1d2d68117 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:25.728403 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fb19495e-1967-48ce-bad0-0ca1d2d68117 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:25.745464 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-d3d47228-5639-4a2e-b894-2221a941bc69 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:23:25.746074 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-d3d47228-5639-4a2e-b894-2221a941bc69 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: f7a41dc5-d258-475a-a1c1-9aad0723d5cb] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:23:25.752665 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d3d47228-5639-4a2e-b894-2221a941bc69 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:25.753153 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d3d47228-5639-4a2e-b894-2221a941bc69 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:25.753933 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d3d47228-5639-4a2e-b894-2221a941bc69 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:25.754374 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d3d47228-5639-4a2e-b894-2221a941bc69 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:25.910431 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-fb19495e-1967-48ce-bad0-0ca1d2d68117 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:23:25.937241 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-fb19495e-1967-48ce-bad0-0ca1d2d68117 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e" status: 200 len: 1675 microversion: 2.1 time: 0.221960 Jul 28 18:23:25.938460 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 487/982] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:23:25 2022] GET /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e => generated 1675 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:23:25.954284 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-d3d47228-5639-4a2e-b894-2221a941bc69 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:23:25.965477 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-d3d47228-5639-4a2e-b894-2221a941bc69 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb" status: 200 len: 1364 microversion: 2.1 time: 0.223696 Jul 28 18:23:25.978916 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 496/983] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:23:25 2022] GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb => generated 1364 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:23:26.577927 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-768fc2c3-5aca-458f-8242-420bd3c76318 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:23:26.578439 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-768fc2c3-5aca-458f-8242-420bd3c76318 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:23:26.580929 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:23:26.586376 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-768fc2c3-5aca-458f-8242-420bd3c76318 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:26.587083 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-768fc2c3-5aca-458f-8242-420bd3c76318 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:26.587859 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-768fc2c3-5aca-458f-8242-420bd3c76318 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:26.588318 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-768fc2c3-5aca-458f-8242-420bd3c76318 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:26.726780 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-768fc2c3-5aca-458f-8242-420bd3c76318 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba025a383c433b900a3f4ae64959b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf347b1959b247bcbe003ac3662cb239', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:23:26.734522 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-768fc2c3-5aca-458f-8242-420bd3c76318 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213" status: 200 len: 1568 microversion: 2.1 time: 0.160635 Jul 28 18:23:26.735085 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 488/984] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:23:26 2022] GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:23:26.960005 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-b07b5b78-b3ac-4da3-9dbb-9fa6217fc61e tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:23:26.960640 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-b07b5b78-b3ac-4da3-9dbb-9fa6217fc61e tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: d729ee22-6dee-45a8-8460-14230cc47c0e] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:23:26.967421 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b07b5b78-b3ac-4da3-9dbb-9fa6217fc61e tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:26.967866 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b07b5b78-b3ac-4da3-9dbb-9fa6217fc61e tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:26.968615 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b07b5b78-b3ac-4da3-9dbb-9fa6217fc61e tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:26.969107 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b07b5b78-b3ac-4da3-9dbb-9fa6217fc61e tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:26.986162 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ed7cb3f4-7a21-4f5b-9518-b65ced355bbc tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:23:26.986773 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ed7cb3f4-7a21-4f5b-9518-b65ced355bbc tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: f7a41dc5-d258-475a-a1c1-9aad0723d5cb] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:23:26.992727 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ed7cb3f4-7a21-4f5b-9518-b65ced355bbc tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:26.993233 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ed7cb3f4-7a21-4f5b-9518-b65ced355bbc tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:26.993988 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ed7cb3f4-7a21-4f5b-9518-b65ced355bbc tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:26.994431 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ed7cb3f4-7a21-4f5b-9518-b65ced355bbc tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:27.164240 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-b07b5b78-b3ac-4da3-9dbb-9fa6217fc61e tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:23:27.171846 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-b07b5b78-b3ac-4da3-9dbb-9fa6217fc61e tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e" status: 200 len: 1675 microversion: 2.1 time: 0.216215 Jul 28 18:23:27.172420 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 497/985] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:23:26 2022] GET /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e => generated 1675 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:23:27.185135 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ed7cb3f4-7a21-4f5b-9518-b65ced355bbc tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:23:27.193930 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ed7cb3f4-7a21-4f5b-9518-b65ced355bbc tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb" status: 200 len: 1364 microversion: 2.1 time: 0.211517 Jul 28 18:23:27.197868 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 489/986] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:23:26 2022] GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb => generated 1364 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:23:27.756256 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-757e76ce-fa0e-4ba4-a93e-6117721ca100 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:23:27.756909 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-757e76ce-fa0e-4ba4-a93e-6117721ca100 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:23:27.763281 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-757e76ce-fa0e-4ba4-a93e-6117721ca100 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:27.763728 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-757e76ce-fa0e-4ba4-a93e-6117721ca100 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:27.764495 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-757e76ce-fa0e-4ba4-a93e-6117721ca100 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:27.764934 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-757e76ce-fa0e-4ba4-a93e-6117721ca100 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:28.003645 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-757e76ce-fa0e-4ba4-a93e-6117721ca100 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba025a383c433b900a3f4ae64959b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf347b1959b247bcbe003ac3662cb239', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:23:28.010962 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-757e76ce-fa0e-4ba4-a93e-6117721ca100 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213" status: 200 len: 1568 microversion: 2.1 time: 0.259244 Jul 28 18:23:28.011735 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 498/987] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:23:27 2022] GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213 => generated 1568 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:23:28.192429 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f6d196fa-fc52-4273-ab88-2af4a7306b6f tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:23:28.193397 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f6d196fa-fc52-4273-ab88-2af4a7306b6f tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: d729ee22-6dee-45a8-8460-14230cc47c0e] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:23:28.200081 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f6d196fa-fc52-4273-ab88-2af4a7306b6f tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:28.200538 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f6d196fa-fc52-4273-ab88-2af4a7306b6f tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:28.201345 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f6d196fa-fc52-4273-ab88-2af4a7306b6f tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:28.201799 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f6d196fa-fc52-4273-ab88-2af4a7306b6f tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:28.205917 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:23:28.217588 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-048c3253-a5eb-480f-9677-b2bb560487b2 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:23:28.222212 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-048c3253-a5eb-480f-9677-b2bb560487b2 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: f7a41dc5-d258-475a-a1c1-9aad0723d5cb] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:23:28.225119 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-048c3253-a5eb-480f-9677-b2bb560487b2 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:28.225641 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-048c3253-a5eb-480f-9677-b2bb560487b2 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:28.226494 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-048c3253-a5eb-480f-9677-b2bb560487b2 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:28.227007 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-048c3253-a5eb-480f-9677-b2bb560487b2 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:28.879111 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-048c3253-a5eb-480f-9677-b2bb560487b2 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:23:28.887386 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-048c3253-a5eb-480f-9677-b2bb560487b2 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb" status: 200 len: 1364 microversion: 2.1 time: 0.673832 Jul 28 18:23:28.888183 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 499/988] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:23:28 2022] GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb => generated 1364 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:23:28.888783 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f6d196fa-fc52-4273-ab88-2af4a7306b6f tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:23:28.897729 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f6d196fa-fc52-4273-ab88-2af4a7306b6f tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e" status: 200 len: 1675 microversion: 2.1 time: 0.709209 Jul 28 18:23:28.898560 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 490/989] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:23:28 2022] GET /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e => generated 1675 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:23:29.032010 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-976e3d4b-2ccd-464b-a1cb-423658a88655 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:23:29.032628 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-976e3d4b-2ccd-464b-a1cb-423658a88655 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:23:29.039867 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-976e3d4b-2ccd-464b-a1cb-423658a88655 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:29.040356 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-976e3d4b-2ccd-464b-a1cb-423658a88655 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:29.041161 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-976e3d4b-2ccd-464b-a1cb-423658a88655 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:29.041592 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-976e3d4b-2ccd-464b-a1cb-423658a88655 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:29.286306 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-976e3d4b-2ccd-464b-a1cb-423658a88655 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba025a383c433b900a3f4ae64959b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf347b1959b247bcbe003ac3662cb239', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:23:29.294526 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-976e3d4b-2ccd-464b-a1cb-423658a88655 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213" status: 200 len: 1568 microversion: 2.1 time: 0.266665 Jul 28 18:23:29.297154 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 500/990] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:23:29 2022] GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213 => generated 1568 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:23:29.482541 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [req-0ad24bbf-23b8-4c8f-9b07-a5fe2228845f req-6de978b6-6412-4f5c-ba33-9241427adec2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d729ee22-6dee-45a8-8460-14230cc47c0e", "name": "network-vif-deleted", "tag": "ed94d36a-868e-4de5-a346-139f9947c086"}]} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:23:29.484123 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-c6360b37-b9f4-47d6-83fa-58953782385e req-191f4b78-a185-4c42-bbd4-078ce7571d30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb0a115f-17bf-4501-af27-0802f70ac213", "name": "network-vif-deleted", "tag": "5415e2f4-0f86-4921-bdc7-f0bf38bcd3e3"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:23:29.504192 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-c6360b37-b9f4-47d6-83fa-58953782385e req-191f4b78-a185-4c42-bbd4-078ce7571d30 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:29.504695 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-c6360b37-b9f4-47d6-83fa-58953782385e req-191f4b78-a185-4c42-bbd4-078ce7571d30 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:29.516697 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-0ad24bbf-23b8-4c8f-9b07-a5fe2228845f req-6de978b6-6412-4f5c-ba33-9241427adec2 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:29.517200 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-0ad24bbf-23b8-4c8f-9b07-a5fe2228845f req-6de978b6-6412-4f5c-ba33-9241427adec2 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:29.522230 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-c6360b37-b9f4-47d6-83fa-58953782385e req-191f4b78-a185-4c42-bbd4-078ce7571d30 service nova] Creating event network-vif-deleted:5415e2f4-0f86-4921-bdc7-f0bf38bcd3e3 for instance eb0a115f-17bf-4501-af27-0802f70ac213 on hv-cinder-84617 Jul 28 18:23:29.530212 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-c6360b37-b9f4-47d6-83fa-58953782385e req-191f4b78-a185-4c42-bbd4-078ce7571d30 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054657 Jul 28 18:23:29.530212 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 491/991] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:23:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:23:29.537172 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.compute.server_external_events [req-0ad24bbf-23b8-4c8f-9b07-a5fe2228845f req-6de978b6-6412-4f5c-ba33-9241427adec2 service nova] Creating event network-vif-deleted:ed94d36a-868e-4de5-a346-139f9947c086 for instance d729ee22-6dee-45a8-8460-14230cc47c0e on hv-cinder-84617 Jul 28 18:23:29.542689 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [req-0ad24bbf-23b8-4c8f-9b07-a5fe2228845f req-6de978b6-6412-4f5c-ba33-9241427adec2 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064036 Jul 28 18:23:29.543324 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 501/992] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:23:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:23:29.908557 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-296718a8-4f7e-4ccc-a5a4-2dafaf08641a tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:23:29.909646 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-296718a8-4f7e-4ccc-a5a4-2dafaf08641a tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: f7a41dc5-d258-475a-a1c1-9aad0723d5cb] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:23:29.916486 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-296718a8-4f7e-4ccc-a5a4-2dafaf08641a tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:29.917224 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-296718a8-4f7e-4ccc-a5a4-2dafaf08641a tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:29.918206 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-296718a8-4f7e-4ccc-a5a4-2dafaf08641a tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:29.919369 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-296718a8-4f7e-4ccc-a5a4-2dafaf08641a tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:29.920365 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-c6e70b67-a8ca-4ee3-a3c2-eb7bbf60e172 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:23:29.921049 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-c6e70b67-a8ca-4ee3-a3c2-eb7bbf60e172 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: d729ee22-6dee-45a8-8460-14230cc47c0e] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:23:29.933708 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c6e70b67-a8ca-4ee3-a3c2-eb7bbf60e172 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:29.934169 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c6e70b67-a8ca-4ee3-a3c2-eb7bbf60e172 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:29.935277 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c6e70b67-a8ca-4ee3-a3c2-eb7bbf60e172 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:29.935770 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c6e70b67-a8ca-4ee3-a3c2-eb7bbf60e172 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:30.025593 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-c6e70b67-a8ca-4ee3-a3c2-eb7bbf60e172 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9874df18af245688db1137b6f1b0bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b91f25d2be408ba9e8d667a574a7a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:23:30.034224 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-c6e70b67-a8ca-4ee3-a3c2-eb7bbf60e172 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e" status: 200 len: 1323 microversion: 2.1 time: 0.118142 Jul 28 18:23:30.055713 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 502/993] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:23:29 2022] GET /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e => generated 1323 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:23:30.094619 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-296718a8-4f7e-4ccc-a5a4-2dafaf08641a tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:23:30.103261 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-296718a8-4f7e-4ccc-a5a4-2dafaf08641a tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb" status: 200 len: 1555 microversion: 2.1 time: 0.198951 Jul 28 18:23:30.104106 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 492/994] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:23:29 2022] GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb => generated 1555 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:23:30.125621 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-093a7a29-adc7-42b6-864b-a223f1c87e28 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:23:30.126144 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-093a7a29-adc7-42b6-864b-a223f1c87e28 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: f7a41dc5-d258-475a-a1c1-9aad0723d5cb] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:23:30.134810 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-093a7a29-adc7-42b6-864b-a223f1c87e28 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:30.135268 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-093a7a29-adc7-42b6-864b-a223f1c87e28 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:30.136044 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-093a7a29-adc7-42b6-864b-a223f1c87e28 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:30.136891 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-093a7a29-adc7-42b6-864b-a223f1c87e28 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:30.224252 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-093a7a29-adc7-42b6-864b-a223f1c87e28 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.102492 Jul 28 18:23:30.231828 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 503/995] 10.222.0.86 () {58 vars in 1275 bytes} [Thu Jul 28 18:23:30 2022] GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:23:30.316405 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f082d269-b629-414d-b0b1-3b8d9289665e tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:23:30.317127 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f082d269-b629-414d-b0b1-3b8d9289665e tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:23:30.324282 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f082d269-b629-414d-b0b1-3b8d9289665e tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:30.327529 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f082d269-b629-414d-b0b1-3b8d9289665e tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:30.327529 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f082d269-b629-414d-b0b1-3b8d9289665e tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:30.327529 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f082d269-b629-414d-b0b1-3b8d9289665e tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:30.416891 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f082d269-b629-414d-b0b1-3b8d9289665e tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba025a383c433b900a3f4ae64959b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf347b1959b247bcbe003ac3662cb239', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:23:30.425348 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f082d269-b629-414d-b0b1-3b8d9289665e tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213" status: 200 len: 1218 microversion: 2.1 time: 0.113400 Jul 28 18:23:30.426419 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 493/996] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:23:30 2022] GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213 => generated 1218 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:23:31.056553 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-09b268cc-0623-46fe-8069-0778fa348dcc tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:23:31.057547 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-09b268cc-0623-46fe-8069-0778fa348dcc tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: d729ee22-6dee-45a8-8460-14230cc47c0e] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:23:31.063644 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-09b268cc-0623-46fe-8069-0778fa348dcc tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:31.064073 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-09b268cc-0623-46fe-8069-0778fa348dcc tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:31.064841 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-09b268cc-0623-46fe-8069-0778fa348dcc tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:31.065309 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-09b268cc-0623-46fe-8069-0778fa348dcc tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:31.078815 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.wsgi [None req-09b268cc-0623-46fe-8069-0778fa348dcc tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] HTTP exception thrown: Instance d729ee22-6dee-45a8-8460-14230cc47c0e could not be found. Jul 28 18:23:31.080478 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-09b268cc-0623-46fe-8069-0778fa348dcc tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Request method failure captured: Jul 28 18:23:31.080478 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: request: GET /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e HTTP/1.1 Jul 28 18:23:31.080478 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Accept: application/json Jul 28 18:23:31.080478 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Accept-Encoding: identity Jul 28 18:23:31.080478 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Connection: close Jul 28 18:23:31.080478 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Content-Length: 0 Jul 28 18:23:31.080478 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Content-Type: application/json Jul 28 18:23:31.080478 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Host: 10.222.0.86 Jul 28 18:23:31.080478 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Openstack-System-Scope: None Jul 28 18:23:31.080478 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: User-Agent: python-urllib3/1.26.10 Jul 28 18:23:31.080478 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Auth-Token: gAAAAABi4tGZwQqhDXNpTfepZnH03id89znztxzbAkUoDYCpmR89uQmPd_pwxY8T0tqiEQgonQdZupDmunanwgaXh53F1U2jPZuOy0ejShuSnTpD6FdOLZAlpwOktLJ8cvE9Pr7OjzPe3O4_PKKJ2Xns136QGP8xbtp1GjM9MiCA62BwFaEpJbo Jul 28 18:23:31.080478 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Domain-Id: None Jul 28 18:23:31.080478 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Domain-Name: None Jul 28 18:23:31.080478 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Identity-Status: Confirmed Jul 28 18:23:31.080478 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Is-Admin-Project: True Jul 28 18:23:31.080478 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Domain-Id: default Jul 28 18:23:31.080478 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Domain-Name: Default Jul 28 18:23:31.080478 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Id: 27b91f25d2be408ba9e8d667a574a7a9 Jul 28 18:23:31.080478 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Name: tempest-AttachVolumeTestJSON-1940292949 Jul 28 18:23:31.080478 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Role: member,reader Jul 28 18:23:31.080478 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Roles: member,reader Jul 28 18:23:31.082091 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_27b91f25d2be408ba9e8d667a574a7a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/27b91f25d2be408ba9e8d667a574a7a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/27b91f25d2be408ba9e8d667a574a7a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/27b91f25d2be408ba9e8d667a574a7a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}] Jul 28 18:23:31.082091 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant: tempest-AttachVolumeTestJSON-1940292949 Jul 28 18:23:31.082091 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant-Id: 27b91f25d2be408ba9e8d667a574a7a9 Jul 28 18:23:31.082091 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1940292949 Jul 28 18:23:31.082091 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User: tempest-AttachVolumeTestJSON-1940292949-project Jul 28 18:23:31.082091 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Domain-Id: default Jul 28 18:23:31.082091 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Domain-Name: Default Jul 28 18:23:31.082091 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Id: b9874df18af245688db1137b6f1b0bff Jul 28 18:23:31.082091 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Name: tempest-AttachVolumeTestJSON-1940292949-project Jul 28 18:23:31.082091 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: method: > Jul 28 18:23:31.082091 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: exception: Instance d729ee22-6dee-45a8-8460-14230cc47c0e could not be found. Jul 28 18:23:31.082091 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: action_args: {'id': 'd729ee22-6dee-45a8-8460-14230cc47c0e'} Jul 28 18:23:31.082965 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:23:31.082965 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:23:31.082965 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:23:31.082965 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:23:31.082965 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:23:31.082965 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:23:31.082965 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:23:31.082965 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:23:31.082965 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:23:31.082965 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:23:31.082965 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d729ee22-6dee-45a8-8460-14230cc47c0e could not be found. Jul 28 18:23:31.082965 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:23:31.082965 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:23:31.082965 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:23:31.082965 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:23:31.082965 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:23:31.082965 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:23:31.082965 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:23:31.082965 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:23:31.082965 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:23:31.084440 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:23:31.084440 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 18:23:31.084440 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 18:23:31.084440 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:23:31.084440 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:23:31.084440 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:23:31.084440 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:23:31.084440 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d729ee22-6dee-45a8-8460-14230cc47c0e could not be found. Jul 28 18:23:31.084440 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:23:31.084440 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:23:31.084440 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:23:31.084440 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:23:31.084440 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:23:31.084440 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:23:31.084440 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:23:31.084440 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:23:31.084440 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d729ee22-6dee-45a8-8460-14230cc47c0e could not be found. Jul 28 18:23:31.084440 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:23:31.086091 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-09b268cc-0623-46fe-8069-0778fa348dcc tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Returning 404 to user: Instance d729ee22-6dee-45a8-8460-14230cc47c0e could not be found. {{(pid=118454) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:23:31.086091 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-09b268cc-0623-46fe-8069-0778fa348dcc tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e" status: 404 len: 111 microversion: 2.1 time: 0.030004 Jul 28 18:23:31.086091 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 504/997] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:23:31 2022] GET /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:23:31.092569 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-63b2fe0b-de66-4bda-92cf-b8e642a544c9 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '.version_select at 0x7f6fe6c52dc0>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:23:31.198235 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-63b2fe0b-de66-4bda-92cf-b8e642a544c9 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1212531576" status: 202 len: 0 microversion: 2.1 time: 0.109981 Jul 28 18:23:31.198809 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 494/998] 10.222.0.86 () {58 vars in 1221 bytes} [Thu Jul 28 18:23:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1212531576 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 18:23:31.455554 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-cf9bac4f-79aa-4de0-9c87-ff12a81cad94 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:23:31.458591 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-cf9bac4f-79aa-4de0-9c87-ff12a81cad94 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:23:31.465834 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-cf9bac4f-79aa-4de0-9c87-ff12a81cad94 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:31.466278 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-cf9bac4f-79aa-4de0-9c87-ff12a81cad94 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:31.467257 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-cf9bac4f-79aa-4de0-9c87-ff12a81cad94 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:31.467855 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-cf9bac4f-79aa-4de0-9c87-ff12a81cad94 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:31.501741 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-cf9bac4f-79aa-4de0-9c87-ff12a81cad94 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:31.502193 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-cf9bac4f-79aa-4de0-9c87-ff12a81cad94 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:31.502660 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.objects.instance [None req-cf9bac4f-79aa-4de0-9c87-ff12a81cad94 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lazy-loading 'fault' on Instance uuid eb0a115f-17bf-4501-af27-0802f70ac213 {{(pid=118454) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:23:31.550318 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-cf9bac4f-79aa-4de0-9c87-ff12a81cad94 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba025a383c433b900a3f4ae64959b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf347b1959b247bcbe003ac3662cb239', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:23:31.562023 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-cf9bac4f-79aa-4de0-9c87-ff12a81cad94 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213" status: 200 len: 1223 microversion: 2.1 time: 0.117865 Jul 28 18:23:31.563307 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 505/999] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:23:31 2022] GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213 => generated 1223 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:23:31.566741 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-0a05caef-1bf0-4f2b-a15e-85312d9dea8c req-11d9a0d6-d361-48c5-90b0-b13ea854f0bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7a41dc5-d258-475a-a1c1-9aad0723d5cb", "tag": "aa7258bd-d420-41dc-a491-75aceff4ed8e"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:23:31.603739 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-0a05caef-1bf0-4f2b-a15e-85312d9dea8c req-11d9a0d6-d361-48c5-90b0-b13ea854f0bf service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:31.604468 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-0a05caef-1bf0-4f2b-a15e-85312d9dea8c req-11d9a0d6-d361-48c5-90b0-b13ea854f0bf service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:31.624490 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-0a05caef-1bf0-4f2b-a15e-85312d9dea8c req-11d9a0d6-d361-48c5-90b0-b13ea854f0bf service nova] Creating event network-changed:aa7258bd-d420-41dc-a491-75aceff4ed8e for instance f7a41dc5-d258-475a-a1c1-9aad0723d5cb on hv-cinder-84617 Jul 28 18:23:31.631667 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-0a05caef-1bf0-4f2b-a15e-85312d9dea8c req-11d9a0d6-d361-48c5-90b0-b13ea854f0bf service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068587 Jul 28 18:23:31.635951 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 495/1000] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:23:32.587227 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-a45c53f3-fdae-4a75-8d1e-2afbbbd091e2 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:23:32.587851 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-a45c53f3-fdae-4a75-8d1e-2afbbbd091e2 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] [instance: eb0a115f-17bf-4501-af27-0802f70ac213] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:23:32.594311 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a45c53f3-fdae-4a75-8d1e-2afbbbd091e2 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:32.597247 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a45c53f3-fdae-4a75-8d1e-2afbbbd091e2 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:32.597247 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a45c53f3-fdae-4a75-8d1e-2afbbbd091e2 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:32.597247 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a45c53f3-fdae-4a75-8d1e-2afbbbd091e2 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:32.609013 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.wsgi [None req-a45c53f3-fdae-4a75-8d1e-2afbbbd091e2 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] HTTP exception thrown: Instance eb0a115f-17bf-4501-af27-0802f70ac213 could not be found. Jul 28 18:23:32.610582 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-a45c53f3-fdae-4a75-8d1e-2afbbbd091e2 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Request method failure captured: Jul 28 18:23:32.610582 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: request: GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213 HTTP/1.1 Jul 28 18:23:32.610582 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Accept: application/json Jul 28 18:23:32.610582 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Accept-Encoding: identity Jul 28 18:23:32.610582 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Connection: close Jul 28 18:23:32.610582 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Content-Length: 0 Jul 28 18:23:32.610582 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Content-Type: application/json Jul 28 18:23:32.610582 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Host: 10.222.0.86 Jul 28 18:23:32.610582 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Openstack-System-Scope: None Jul 28 18:23:32.610582 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: User-Agent: python-urllib3/1.26.10 Jul 28 18:23:32.610582 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Auth-Token: gAAAAABi4tKmhne1zT6HhCiK7MAef3QgBNLL5kudWnw5ESVYIfJzboHcnteOJDViAImMClHgfueZyM94asCO3VeYbGBoeIksrcVo5oTEvSXg0oG23SI9UciwUTfBTScUx0U8eEGGmxLzWPtCOqs_MfovsYLnXMnd2kQaN3nmREZRiZxFn_URulI Jul 28 18:23:32.610582 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Domain-Id: None Jul 28 18:23:32.610582 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Domain-Name: None Jul 28 18:23:32.610582 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Identity-Status: Confirmed Jul 28 18:23:32.610582 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Is-Admin-Project: True Jul 28 18:23:32.610582 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Domain-Id: default Jul 28 18:23:32.610582 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Domain-Name: Default Jul 28 18:23:32.610582 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Id: bf347b1959b247bcbe003ac3662cb239 Jul 28 18:23:32.610582 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Name: tempest-TestShelveInstance-1747104346 Jul 28 18:23:32.610582 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Role: member,reader Jul 28 18:23:32.610582 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Roles: member,reader Jul 28 18:23:32.612242 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_bf347b1959b247bcbe003ac3662cb239"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/bf347b1959b247bcbe003ac3662cb239"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/bf347b1959b247bcbe003ac3662cb239"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/bf347b1959b247bcbe003ac3662cb239"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}] Jul 28 18:23:32.612242 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant: tempest-TestShelveInstance-1747104346 Jul 28 18:23:32.612242 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant-Id: bf347b1959b247bcbe003ac3662cb239 Jul 28 18:23:32.612242 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant-Name: tempest-TestShelveInstance-1747104346 Jul 28 18:23:32.612242 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User: tempest-TestShelveInstance-1747104346-project Jul 28 18:23:32.612242 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Domain-Id: default Jul 28 18:23:32.612242 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Domain-Name: Default Jul 28 18:23:32.612242 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Id: 83ba025a383c433b900a3f4ae64959b3 Jul 28 18:23:32.612242 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Name: tempest-TestShelveInstance-1747104346-project Jul 28 18:23:32.612242 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: method: > Jul 28 18:23:32.612242 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: exception: Instance eb0a115f-17bf-4501-af27-0802f70ac213 could not be found. Jul 28 18:23:32.612242 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: action_args: {'id': 'eb0a115f-17bf-4501-af27-0802f70ac213'} Jul 28 18:23:32.613206 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:23:32.613206 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:23:32.613206 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:23:32.613206 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:23:32.613206 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:23:32.613206 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:23:32.613206 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:23:32.613206 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:23:32.613206 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:23:32.613206 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:23:32.613206 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb0a115f-17bf-4501-af27-0802f70ac213 could not be found. Jul 28 18:23:32.613206 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:23:32.613206 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:23:32.613206 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:23:32.613206 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:23:32.613206 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:23:32.613206 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:23:32.613206 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:23:32.613206 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:23:32.613206 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:23:32.614634 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:23:32.614634 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 18:23:32.614634 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 18:23:32.614634 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:23:32.614634 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:23:32.614634 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:23:32.614634 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:23:32.614634 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb0a115f-17bf-4501-af27-0802f70ac213 could not be found. Jul 28 18:23:32.614634 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:23:32.614634 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:23:32.614634 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:23:32.614634 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:23:32.614634 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:23:32.614634 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:23:32.614634 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:23:32.614634 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:23:32.614634 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb0a115f-17bf-4501-af27-0802f70ac213 could not be found. Jul 28 18:23:32.614634 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:23:32.616774 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-a45c53f3-fdae-4a75-8d1e-2afbbbd091e2 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Returning 404 to user: Instance eb0a115f-17bf-4501-af27-0802f70ac213 could not be found. {{(pid=118454) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:23:32.616774 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-a45c53f3-fdae-4a75-8d1e-2afbbbd091e2 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213" status: 404 len: 111 microversion: 2.1 time: 0.029633 Jul 28 18:23:32.616774 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 506/1001] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:23:32 2022] GET /compute/v2.1/servers/eb0a115f-17bf-4501-af27-0802f70ac213 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:23:32.865565 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ad22b6d7-8c5a-464d-86a7-545035cc6b69 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] Calling method '.version_select at 0x7f6fe2901670>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:23:32.963966 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ad22b6d7-8c5a-464d-86a7-545035cc6b69 tempest-TestShelveInstance-1747104346 tempest-TestShelveInstance-1747104346-project] 10.222.0.86 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-182682276" status: 202 len: 0 microversion: 2.1 time: 0.103544 Jul 28 18:23:32.964543 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 496/1002] 10.222.0.86 () {58 vars in 1251 bytes} [Thu Jul 28 18:23:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-182682276 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 18:23:34.779415 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-5b15cd91-dbe2-4e6c-bb19-7547a691da61 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:23:34.779931 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-5b15cd91-dbe2-4e6c-bb19-7547a691da61 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: d729ee22-6dee-45a8-8460-14230cc47c0e] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:23:34.786729 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-5b15cd91-dbe2-4e6c-bb19-7547a691da61 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:34.787184 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-5b15cd91-dbe2-4e6c-bb19-7547a691da61 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:34.788163 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-5b15cd91-dbe2-4e6c-bb19-7547a691da61 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:34.788774 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-5b15cd91-dbe2-4e6c-bb19-7547a691da61 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:34.803524 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.wsgi [None req-5b15cd91-dbe2-4e6c-bb19-7547a691da61 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] HTTP exception thrown: Instance d729ee22-6dee-45a8-8460-14230cc47c0e could not be found. Jul 28 18:23:34.805457 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-5b15cd91-dbe2-4e6c-bb19-7547a691da61 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Request method failure captured: Jul 28 18:23:34.805457 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: request: DELETE /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e HTTP/1.1 Jul 28 18:23:34.805457 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Accept: application/json Jul 28 18:23:34.805457 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Accept-Encoding: identity Jul 28 18:23:34.805457 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Connection: close Jul 28 18:23:34.805457 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Content-Length: 0 Jul 28 18:23:34.805457 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Content-Type: application/json Jul 28 18:23:34.805457 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Host: 10.222.0.86 Jul 28 18:23:34.805457 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Openstack-System-Scope: None Jul 28 18:23:34.805457 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: User-Agent: python-urllib3/1.26.10 Jul 28 18:23:34.805457 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Auth-Token: gAAAAABi4tGZwQqhDXNpTfepZnH03id89znztxzbAkUoDYCpmR89uQmPd_pwxY8T0tqiEQgonQdZupDmunanwgaXh53F1U2jPZuOy0ejShuSnTpD6FdOLZAlpwOktLJ8cvE9Pr7OjzPe3O4_PKKJ2Xns136QGP8xbtp1GjM9MiCA62BwFaEpJbo Jul 28 18:23:34.805457 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Domain-Id: None Jul 28 18:23:34.805457 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Domain-Name: None Jul 28 18:23:34.805457 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Identity-Status: Confirmed Jul 28 18:23:34.805457 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Is-Admin-Project: True Jul 28 18:23:34.805457 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Domain-Id: default Jul 28 18:23:34.805457 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Domain-Name: Default Jul 28 18:23:34.805457 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Id: 27b91f25d2be408ba9e8d667a574a7a9 Jul 28 18:23:34.805457 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Name: tempest-AttachVolumeTestJSON-1940292949 Jul 28 18:23:34.805457 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Role: member,reader Jul 28 18:23:34.805457 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Roles: member,reader Jul 28 18:23:34.806837 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_27b91f25d2be408ba9e8d667a574a7a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/27b91f25d2be408ba9e8d667a574a7a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/27b91f25d2be408ba9e8d667a574a7a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/27b91f25d2be408ba9e8d667a574a7a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}] Jul 28 18:23:34.806837 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant: tempest-AttachVolumeTestJSON-1940292949 Jul 28 18:23:34.806837 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant-Id: 27b91f25d2be408ba9e8d667a574a7a9 Jul 28 18:23:34.806837 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1940292949 Jul 28 18:23:34.806837 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User: tempest-AttachVolumeTestJSON-1940292949-project Jul 28 18:23:34.806837 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Domain-Id: default Jul 28 18:23:34.806837 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Domain-Name: Default Jul 28 18:23:34.806837 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Id: b9874df18af245688db1137b6f1b0bff Jul 28 18:23:34.806837 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Name: tempest-AttachVolumeTestJSON-1940292949-project Jul 28 18:23:34.806837 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: method: > Jul 28 18:23:34.806837 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: exception: Instance d729ee22-6dee-45a8-8460-14230cc47c0e could not be found. Jul 28 18:23:34.806837 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: action_args: {'id': 'd729ee22-6dee-45a8-8460-14230cc47c0e'} Jul 28 18:23:34.807600 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:23:34.807600 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:23:34.807600 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:23:34.807600 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:23:34.807600 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:23:34.807600 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:23:34.807600 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:23:34.807600 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:23:34.807600 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:23:34.807600 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:23:34.807600 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d729ee22-6dee-45a8-8460-14230cc47c0e could not be found. Jul 28 18:23:34.807600 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:23:34.807600 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:23:34.807600 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:23:34.807600 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:23:34.807600 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:23:34.807600 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:23:34.807600 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:23:34.807600 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:23:34.807600 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:23:34.808804 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:23:34.808804 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 18:23:34.808804 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 18:23:34.808804 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 18:23:34.808804 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 18:23:34.808804 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:23:34.808804 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:23:34.808804 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:23:34.808804 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:23:34.808804 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d729ee22-6dee-45a8-8460-14230cc47c0e could not be found. Jul 28 18:23:34.808804 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:23:34.808804 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:23:34.808804 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:23:34.808804 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:23:34.808804 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:23:34.808804 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:23:34.808804 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:23:34.808804 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:23:34.808804 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d729ee22-6dee-45a8-8460-14230cc47c0e could not be found. Jul 28 18:23:34.808804 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:23:34.810176 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-5b15cd91-dbe2-4e6c-bb19-7547a691da61 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Returning 404 to user: Instance d729ee22-6dee-45a8-8460-14230cc47c0e could not be found. {{(pid=118454) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:23:34.810176 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-5b15cd91-dbe2-4e6c-bb19-7547a691da61 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "DELETE /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e" status: 404 len: 111 microversion: 2.1 time: 0.031359 Jul 28 18:23:34.810176 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 507/1003] 10.222.0.86 () {58 vars in 1239 bytes} [Thu Jul 28 18:23:34 2022] DELETE /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:23:34.816455 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-575393b9-6ebd-4dc9-b431-b5a575b345d1 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:23:34.817231 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-575393b9-6ebd-4dc9-b431-b5a575b345d1 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: d729ee22-6dee-45a8-8460-14230cc47c0e] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:23:34.825486 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-575393b9-6ebd-4dc9-b431-b5a575b345d1 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:34.825945 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-575393b9-6ebd-4dc9-b431-b5a575b345d1 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:34.826730 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-575393b9-6ebd-4dc9-b431-b5a575b345d1 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:34.827178 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-575393b9-6ebd-4dc9-b431-b5a575b345d1 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:34.841879 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.wsgi [None req-575393b9-6ebd-4dc9-b431-b5a575b345d1 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] HTTP exception thrown: Instance d729ee22-6dee-45a8-8460-14230cc47c0e could not be found. Jul 28 18:23:34.843690 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-575393b9-6ebd-4dc9-b431-b5a575b345d1 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Request method failure captured: Jul 28 18:23:34.843690 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: request: GET /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e HTTP/1.1 Jul 28 18:23:34.843690 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Accept: application/json Jul 28 18:23:34.843690 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Accept-Encoding: identity Jul 28 18:23:34.843690 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Connection: close Jul 28 18:23:34.843690 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Content-Length: 0 Jul 28 18:23:34.843690 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Content-Type: application/json Jul 28 18:23:34.843690 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Host: 10.222.0.86 Jul 28 18:23:34.843690 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Openstack-System-Scope: None Jul 28 18:23:34.843690 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: User-Agent: python-urllib3/1.26.10 Jul 28 18:23:34.843690 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Auth-Token: gAAAAABi4tGZwQqhDXNpTfepZnH03id89znztxzbAkUoDYCpmR89uQmPd_pwxY8T0tqiEQgonQdZupDmunanwgaXh53F1U2jPZuOy0ejShuSnTpD6FdOLZAlpwOktLJ8cvE9Pr7OjzPe3O4_PKKJ2Xns136QGP8xbtp1GjM9MiCA62BwFaEpJbo Jul 28 18:23:34.843690 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Domain-Id: None Jul 28 18:23:34.843690 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Domain-Name: None Jul 28 18:23:34.843690 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Identity-Status: Confirmed Jul 28 18:23:34.843690 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Is-Admin-Project: True Jul 28 18:23:34.843690 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Id: default Jul 28 18:23:34.843690 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Name: Default Jul 28 18:23:34.843690 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Id: 27b91f25d2be408ba9e8d667a574a7a9 Jul 28 18:23:34.843690 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Name: tempest-AttachVolumeTestJSON-1940292949 Jul 28 18:23:34.843690 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Role: member,reader Jul 28 18:23:34.843690 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Roles: member,reader Jul 28 18:23:34.852393 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_27b91f25d2be408ba9e8d667a574a7a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/27b91f25d2be408ba9e8d667a574a7a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/27b91f25d2be408ba9e8d667a574a7a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/27b91f25d2be408ba9e8d667a574a7a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}] Jul 28 18:23:34.852393 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant: tempest-AttachVolumeTestJSON-1940292949 Jul 28 18:23:34.852393 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant-Id: 27b91f25d2be408ba9e8d667a574a7a9 Jul 28 18:23:34.852393 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1940292949 Jul 28 18:23:34.852393 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User: tempest-AttachVolumeTestJSON-1940292949-project Jul 28 18:23:34.852393 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Id: default Jul 28 18:23:34.852393 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Name: Default Jul 28 18:23:34.852393 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Id: b9874df18af245688db1137b6f1b0bff Jul 28 18:23:34.852393 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Name: tempest-AttachVolumeTestJSON-1940292949-project Jul 28 18:23:34.852393 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: method: > Jul 28 18:23:34.852393 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: exception: Instance d729ee22-6dee-45a8-8460-14230cc47c0e could not be found. Jul 28 18:23:34.852393 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: action_args: {'id': 'd729ee22-6dee-45a8-8460-14230cc47c0e'} Jul 28 18:23:34.853802 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:23:34.853802 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:23:34.853802 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:23:34.853802 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:23:34.853802 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:23:34.853802 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:23:34.853802 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:23:34.853802 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:23:34.853802 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:23:34.853802 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:23:34.853802 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d729ee22-6dee-45a8-8460-14230cc47c0e could not be found. Jul 28 18:23:34.853802 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:23:34.853802 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:23:34.853802 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:23:34.853802 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:23:34.853802 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:23:34.853802 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:23:34.853802 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:23:34.853802 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:23:34.853802 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:23:34.855313 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:23:34.855313 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 18:23:34.855313 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 18:23:34.855313 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:23:34.855313 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:23:34.855313 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:23:34.855313 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:23:34.855313 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d729ee22-6dee-45a8-8460-14230cc47c0e could not be found. Jul 28 18:23:34.855313 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:23:34.855313 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:23:34.855313 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:23:34.855313 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:23:34.855313 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:23:34.855313 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:23:34.855313 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:23:34.855313 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:23:34.855313 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d729ee22-6dee-45a8-8460-14230cc47c0e could not be found. Jul 28 18:23:34.855313 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:23:34.856667 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-575393b9-6ebd-4dc9-b431-b5a575b345d1 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Returning 404 to user: Instance d729ee22-6dee-45a8-8460-14230cc47c0e could not be found. {{(pid=118453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:23:34.856667 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-575393b9-6ebd-4dc9-b431-b5a575b345d1 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e" status: 404 len: 111 microversion: 2.1 time: 0.033377 Jul 28 18:23:34.856667 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 497/1004] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:23:34 2022] GET /compute/v2.1/servers/d729ee22-6dee-45a8-8460-14230cc47c0e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:23:36.149723 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-be9c9572-7acc-4df7-8215-5b1c69fbf6f8 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:23:36.150915 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-be9c9572-7acc-4df7-8215-5b1c69fbf6f8 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:23:36.157839 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-be9c9572-7acc-4df7-8215-5b1c69fbf6f8 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:36.158259 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-be9c9572-7acc-4df7-8215-5b1c69fbf6f8 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:36.159089 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-be9c9572-7acc-4df7-8215-5b1c69fbf6f8 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:36.159513 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-be9c9572-7acc-4df7-8215-5b1c69fbf6f8 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:36.183081 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.wsgi [None req-be9c9572-7acc-4df7-8215-5b1c69fbf6f8 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] HTTP exception thrown: Instance 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd could not be found. Jul 28 18:23:36.192259 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-be9c9572-7acc-4df7-8215-5b1c69fbf6f8 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Request method failure captured: Jul 28 18:23:36.192259 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: request: DELETE /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd HTTP/1.1 Jul 28 18:23:36.192259 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Accept: application/json Jul 28 18:23:36.192259 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Accept-Encoding: identity Jul 28 18:23:36.192259 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Connection: close Jul 28 18:23:36.192259 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Content-Length: 0 Jul 28 18:23:36.192259 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Content-Type: application/json Jul 28 18:23:36.192259 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Host: 10.222.0.86 Jul 28 18:23:36.192259 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Openstack-System-Scope: None Jul 28 18:23:36.192259 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: User-Agent: python-urllib3/1.26.10 Jul 28 18:23:36.192259 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Auth-Token: gAAAAABi4tGZwQqhDXNpTfepZnH03id89znztxzbAkUoDYCpmR89uQmPd_pwxY8T0tqiEQgonQdZupDmunanwgaXh53F1U2jPZuOy0ejShuSnTpD6FdOLZAlpwOktLJ8cvE9Pr7OjzPe3O4_PKKJ2Xns136QGP8xbtp1GjM9MiCA62BwFaEpJbo Jul 28 18:23:36.192259 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Domain-Id: None Jul 28 18:23:36.192259 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Domain-Name: None Jul 28 18:23:36.192259 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Identity-Status: Confirmed Jul 28 18:23:36.192259 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Is-Admin-Project: True Jul 28 18:23:36.192259 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Domain-Id: default Jul 28 18:23:36.192259 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Domain-Name: Default Jul 28 18:23:36.192259 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Id: 27b91f25d2be408ba9e8d667a574a7a9 Jul 28 18:23:36.192259 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Name: tempest-AttachVolumeTestJSON-1940292949 Jul 28 18:23:36.192259 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Role: member,reader Jul 28 18:23:36.192259 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Roles: member,reader Jul 28 18:23:36.194808 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_27b91f25d2be408ba9e8d667a574a7a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/27b91f25d2be408ba9e8d667a574a7a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/27b91f25d2be408ba9e8d667a574a7a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/27b91f25d2be408ba9e8d667a574a7a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}] Jul 28 18:23:36.194808 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant: tempest-AttachVolumeTestJSON-1940292949 Jul 28 18:23:36.194808 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant-Id: 27b91f25d2be408ba9e8d667a574a7a9 Jul 28 18:23:36.194808 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1940292949 Jul 28 18:23:36.194808 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User: tempest-AttachVolumeTestJSON-1940292949-project Jul 28 18:23:36.194808 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Domain-Id: default Jul 28 18:23:36.194808 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Domain-Name: Default Jul 28 18:23:36.194808 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Id: b9874df18af245688db1137b6f1b0bff Jul 28 18:23:36.194808 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Name: tempest-AttachVolumeTestJSON-1940292949-project Jul 28 18:23:36.194808 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: method: > Jul 28 18:23:36.194808 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: exception: Instance 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd could not be found. Jul 28 18:23:36.194808 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: action_args: {'id': '3f8c8622-dfde-4eb5-95c4-7716aebf0fcd'} Jul 28 18:23:36.195700 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:23:36.195700 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:23:36.195700 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:23:36.195700 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:23:36.195700 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:23:36.195700 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:23:36.195700 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:23:36.195700 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:23:36.195700 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:23:36.195700 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:23:36.195700 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd could not be found. Jul 28 18:23:36.195700 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:23:36.195700 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:23:36.195700 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:23:36.195700 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:23:36.195700 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:23:36.195700 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:23:36.195700 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:23:36.195700 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:23:36.195700 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:23:36.197328 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:23:36.197328 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 18:23:36.197328 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 18:23:36.197328 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 18:23:36.197328 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 18:23:36.197328 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:23:36.197328 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:23:36.197328 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:23:36.197328 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:23:36.197328 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd could not be found. Jul 28 18:23:36.197328 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:23:36.197328 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:23:36.197328 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:23:36.197328 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:23:36.197328 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:23:36.197328 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:23:36.197328 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:23:36.197328 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:23:36.197328 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd could not be found. Jul 28 18:23:36.197328 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:23:36.199888 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-be9c9572-7acc-4df7-8215-5b1c69fbf6f8 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Returning 404 to user: Instance 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd could not be found. {{(pid=118454) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:23:36.199888 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-be9c9572-7acc-4df7-8215-5b1c69fbf6f8 tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "DELETE /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 404 len: 111 microversion: 2.1 time: 0.042454 Jul 28 18:23:36.199888 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 508/1005] 10.222.0.86 () {58 vars in 1239 bytes} [Thu Jul 28 18:23:36 2022] DELETE /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:23:36.201619 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ca0f6663-3615-4bbf-a096-acca7f85796d tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:23:36.202247 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ca0f6663-3615-4bbf-a096-acca7f85796d tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] [instance: 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:23:36.209593 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ca0f6663-3615-4bbf-a096-acca7f85796d tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:36.210260 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ca0f6663-3615-4bbf-a096-acca7f85796d tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:36.211298 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ca0f6663-3615-4bbf-a096-acca7f85796d tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:23:36.212170 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ca0f6663-3615-4bbf-a096-acca7f85796d tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:23:36.228822 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.wsgi [None req-ca0f6663-3615-4bbf-a096-acca7f85796d tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] HTTP exception thrown: Instance 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd could not be found. Jul 28 18:23:36.230491 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ca0f6663-3615-4bbf-a096-acca7f85796d tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Request method failure captured: Jul 28 18:23:36.230491 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: request: GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd HTTP/1.1 Jul 28 18:23:36.230491 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Accept: application/json Jul 28 18:23:36.230491 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Accept-Encoding: identity Jul 28 18:23:36.230491 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Connection: close Jul 28 18:23:36.230491 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Content-Length: 0 Jul 28 18:23:36.230491 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Content-Type: application/json Jul 28 18:23:36.230491 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Host: 10.222.0.86 Jul 28 18:23:36.230491 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Openstack-System-Scope: None Jul 28 18:23:36.230491 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: User-Agent: python-urllib3/1.26.10 Jul 28 18:23:36.230491 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Auth-Token: gAAAAABi4tGZwQqhDXNpTfepZnH03id89znztxzbAkUoDYCpmR89uQmPd_pwxY8T0tqiEQgonQdZupDmunanwgaXh53F1U2jPZuOy0ejShuSnTpD6FdOLZAlpwOktLJ8cvE9Pr7OjzPe3O4_PKKJ2Xns136QGP8xbtp1GjM9MiCA62BwFaEpJbo Jul 28 18:23:36.230491 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Domain-Id: None Jul 28 18:23:36.230491 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Domain-Name: None Jul 28 18:23:36.230491 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Identity-Status: Confirmed Jul 28 18:23:36.230491 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Is-Admin-Project: True Jul 28 18:23:36.230491 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Id: default Jul 28 18:23:36.230491 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Name: Default Jul 28 18:23:36.230491 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Id: 27b91f25d2be408ba9e8d667a574a7a9 Jul 28 18:23:36.230491 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Name: tempest-AttachVolumeTestJSON-1940292949 Jul 28 18:23:36.230491 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Role: member,reader Jul 28 18:23:36.230491 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Roles: member,reader Jul 28 18:23:36.239119 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_27b91f25d2be408ba9e8d667a574a7a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/27b91f25d2be408ba9e8d667a574a7a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/27b91f25d2be408ba9e8d667a574a7a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/27b91f25d2be408ba9e8d667a574a7a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}] Jul 28 18:23:36.239119 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant: tempest-AttachVolumeTestJSON-1940292949 Jul 28 18:23:36.239119 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant-Id: 27b91f25d2be408ba9e8d667a574a7a9 Jul 28 18:23:36.239119 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1940292949 Jul 28 18:23:36.239119 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User: tempest-AttachVolumeTestJSON-1940292949-project Jul 28 18:23:36.239119 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Id: default Jul 28 18:23:36.239119 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Name: Default Jul 28 18:23:36.239119 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Id: b9874df18af245688db1137b6f1b0bff Jul 28 18:23:36.239119 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Name: tempest-AttachVolumeTestJSON-1940292949-project Jul 28 18:23:36.239119 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: method: > Jul 28 18:23:36.239119 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: exception: Instance 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd could not be found. Jul 28 18:23:36.239119 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: action_args: {'id': '3f8c8622-dfde-4eb5-95c4-7716aebf0fcd'} Jul 28 18:23:36.240672 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:23:36.240672 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:23:36.240672 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:23:36.240672 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:23:36.240672 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:23:36.240672 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:23:36.240672 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:23:36.240672 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:23:36.240672 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:23:36.240672 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:23:36.240672 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd could not be found. Jul 28 18:23:36.240672 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:23:36.240672 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:23:36.240672 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:23:36.240672 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:23:36.240672 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:23:36.240672 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:23:36.240672 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:23:36.240672 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:23:36.240672 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:23:36.243318 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:23:36.243318 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 18:23:36.243318 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 18:23:36.243318 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:23:36.243318 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:23:36.243318 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:23:36.243318 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:23:36.243318 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd could not be found. Jul 28 18:23:36.243318 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:23:36.243318 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:23:36.243318 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:23:36.243318 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:23:36.243318 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:23:36.243318 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:23:36.243318 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:23:36.243318 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:23:36.243318 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd could not be found. Jul 28 18:23:36.243318 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:23:36.244632 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ca0f6663-3615-4bbf-a096-acca7f85796d tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] Returning 404 to user: Instance 3f8c8622-dfde-4eb5-95c4-7716aebf0fcd could not be found. {{(pid=118453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:23:36.244632 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ca0f6663-3615-4bbf-a096-acca7f85796d tempest-AttachVolumeTestJSON-1940292949 tempest-AttachVolumeTestJSON-1940292949-project] 10.222.0.86 "GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd" status: 404 len: 111 microversion: 2.1 time: 0.035767 Jul 28 18:23:36.244632 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 498/1006] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:23:36 2022] GET /compute/v2.1/servers/3f8c8622-dfde-4eb5-95c4-7716aebf0fcd => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:24:04.455310 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-5292aee9-6583-41c6-80c0-377d31d89554 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1555075281", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-554928045", "security_groups": [{"name": "tempest-secgroup-smoke-370419790"}], "block_device_mapping_v2": [{"uuid": "c4e3a553-25f5-48b3-a576-25a857d44818", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f4b4861e-a1c6-45e0-a934-67c667a84812"}]}} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:24:04.465239 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:24:04.465889 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell1:SELECT=70 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:24:04.568165 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.network.neutron [None req-5292aee9-6583-41c6-80c0-377d31d89554 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] validate_networks() for [('f4b4861e-a1c6-45e0-a934-67c667a84812', None, None, None, None, None)] {{(pid=118454) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 18:24:04.946806 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.virt.hardware [None req-5292aee9-6583-41c6-80c0-377d31d89554 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Flavor limits 0:0:0 {{(pid=118454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 18:24:04.950368 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.virt.hardware [None req-5292aee9-6583-41c6-80c0-377d31d89554 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Image limits 0:0:0 {{(pid=118454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 18:24:04.950368 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.virt.hardware [None req-5292aee9-6583-41c6-80c0-377d31d89554 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Flavor pref 0:0:0 {{(pid=118454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 18:24:04.950368 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.virt.hardware [None req-5292aee9-6583-41c6-80c0-377d31d89554 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Image pref 0:0:0 {{(pid=118454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 18:24:04.950368 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.virt.hardware [None req-5292aee9-6583-41c6-80c0-377d31d89554 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 18:24:04.957653 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-5292aee9-6583-41c6-80c0-377d31d89554 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:04.958110 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-5292aee9-6583-41c6-80c0-377d31d89554 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:04.959025 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-5292aee9-6583-41c6-80c0-377d31d89554 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:04.959465 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-5292aee9-6583-41c6-80c0-377d31d89554 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:04.979085 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.quota [None req-5292aee9-6583-41c6-80c0-377d31d89554 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Getting quotas for project 308e6cf086ae4cdea9c591ed2811c976. Resources: {'cores', 'ram', 'instances'} {{(pid=118454) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 18:24:04.983298 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.quota [None req-5292aee9-6583-41c6-80c0-377d31d89554 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Getting quotas for user 30f0002d2a5a4950b2f1aa771f33bbc1 and project 308e6cf086ae4cdea9c591ed2811c976. Resources: {'cores', 'ram', 'instances'} {{(pid=118454) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 18:24:05.042614 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-5292aee9-6583-41c6-80c0-377d31d89554 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Going to run 1 instances... {{(pid=118454) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 18:24:05.044722 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-5292aee9-6583-41c6-80c0-377d31d89554 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: b7714792-fa29-4af9-b28a-431c9bb2f5b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c4e3a553-25f5-48b3-a576-25a857d44818',volume_size=None,volume_type=None)] {{(pid=118454) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 18:24:05.427535 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-5292aee9-6583-41c6-80c0-377d31d89554 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.975998 Jul 28 18:24:05.428270 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 509/1007] 10.222.0.86 () {60 vars in 1147 bytes} [Thu Jul 28 18:24:04 2022] POST /compute/v2.1/servers => generated 405 bytes in 978 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 18:24:05.440294 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-e14c0759-f70e-4071-ae76-fe0d29f0dd79 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:05.440896 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-e14c0759-f70e-4071-ae76-fe0d29f0dd79 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: b7714792-fa29-4af9-b28a-431c9bb2f5b2] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:24:05.444599 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=2 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:24:05.445275 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=24 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:24:05.502090 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-e14c0759-f70e-4071-ae76-fe0d29f0dd79 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:24:05.509363 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-e14c0759-f70e-4071-ae76-fe0d29f0dd79 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/b7714792-fa29-4af9-b28a-431c9bb2f5b2" status: 200 len: 1094 microversion: 2.1 time: 0.073122 Jul 28 18:24:05.509973 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 499/1008] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:24:05 2022] GET /compute/v2.1/servers/b7714792-fa29-4af9-b28a-431c9bb2f5b2 => generated 1094 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:24:06.534695 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-8bf6a2d5-08ab-4079-a0ac-f77392c3dcd7 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:06.535347 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-8bf6a2d5-08ab-4079-a0ac-f77392c3dcd7 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: b7714792-fa29-4af9-b28a-431c9bb2f5b2] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:24:06.546583 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-8bf6a2d5-08ab-4079-a0ac-f77392c3dcd7 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:06.547039 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-8bf6a2d5-08ab-4079-a0ac-f77392c3dcd7 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:06.552374 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-8bf6a2d5-08ab-4079-a0ac-f77392c3dcd7 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:06.552374 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-8bf6a2d5-08ab-4079-a0ac-f77392c3dcd7 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:06.569625 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-cd215599-2dd5-42e3-93c0-a833cc32e2a3 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:06.571838 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-cd215599-2dd5-42e3-93c0-a833cc32e2a3 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:24:06.580603 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cd215599-2dd5-42e3-93c0-a833cc32e2a3 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:06.581433 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cd215599-2dd5-42e3-93c0-a833cc32e2a3 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:06.582362 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cd215599-2dd5-42e3-93c0-a833cc32e2a3 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:06.582964 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cd215599-2dd5-42e3-93c0-a833cc32e2a3 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:06.615903 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-8bf6a2d5-08ab-4079-a0ac-f77392c3dcd7 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:24:06.616609 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-cd215599-2dd5-42e3-93c0-a833cc32e2a3 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050867 Jul 28 18:24:06.625230 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-8bf6a2d5-08ab-4079-a0ac-f77392c3dcd7 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/b7714792-fa29-4af9-b28a-431c9bb2f5b2" status: 200 len: 1144 microversion: 2.1 time: 0.095024 Jul 28 18:24:06.626438 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 510/1009] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:24:06 2022] GET /compute/v2.1/servers/b7714792-fa29-4af9-b28a-431c9bb2f5b2 => generated 1144 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:24:06.632108 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 500/1010] 10.222.0.86 () {60 vars in 1343 bytes} [Thu Jul 28 18:24:06 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:24:06.686094 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-24a76521-c5e1-405a-96ca-3fc879298b9a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:06.686773 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-24a76521-c5e1-405a-96ca-3fc879298b9a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:24:06.692900 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-24a76521-c5e1-405a-96ca-3fc879298b9a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:06.693396 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-24a76521-c5e1-405a-96ca-3fc879298b9a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:06.694167 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-24a76521-c5e1-405a-96ca-3fc879298b9a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:06.694607 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-24a76521-c5e1-405a-96ca-3fc879298b9a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:06.719988 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-24a76521-c5e1-405a-96ca-3fc879298b9a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Going to try to terminate instance {{(pid=118454) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 18:24:07.030265 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-24a76521-c5e1-405a-96ca-3fc879298b9a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "DELETE /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 204 len: 0 microversion: 2.20 time: 0.348140 Jul 28 18:24:07.030857 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 511/1011] 10.222.0.86 () {60 vars in 1280 bytes} [Thu Jul 28 18:24:06 2022] DELETE /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 18:24:07.039049 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-395b33a5-c22c-4dcd-8635-a00941737951 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:07.040039 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-395b33a5-c22c-4dcd-8635-a00941737951 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:24:07.046014 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-395b33a5-c22c-4dcd-8635-a00941737951 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:07.046465 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-395b33a5-c22c-4dcd-8635-a00941737951 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:07.047226 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-395b33a5-c22c-4dcd-8635-a00941737951 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:07.047664 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-395b33a5-c22c-4dcd-8635-a00941737951 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:07.211742 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-395b33a5-c22c-4dcd-8635-a00941737951 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:24:07.220456 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-395b33a5-c22c-4dcd-8635-a00941737951 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:24:07.222652 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-395b33a5-c22c-4dcd-8635-a00941737951 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:24:07.223841 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-395b33a5-c22c-4dcd-8635-a00941737951 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1724 microversion: 2.20 time: 0.188726 Jul 28 18:24:07.224407 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 501/1012] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:24:07 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:24:07.646063 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-1d017b33-b3da-46ef-97f0-5120b1cf80be tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:07.646772 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-1d017b33-b3da-46ef-97f0-5120b1cf80be tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: b7714792-fa29-4af9-b28a-431c9bb2f5b2] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:24:07.653242 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-1d017b33-b3da-46ef-97f0-5120b1cf80be tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:07.653697 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-1d017b33-b3da-46ef-97f0-5120b1cf80be tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:07.654471 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-1d017b33-b3da-46ef-97f0-5120b1cf80be tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:07.654915 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-1d017b33-b3da-46ef-97f0-5120b1cf80be tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:07.719988 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-1d017b33-b3da-46ef-97f0-5120b1cf80be tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:24:07.727624 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-1d017b33-b3da-46ef-97f0-5120b1cf80be tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/b7714792-fa29-4af9-b28a-431c9bb2f5b2" status: 200 len: 1192 microversion: 2.1 time: 0.085865 Jul 28 18:24:07.728184 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 512/1013] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:24:07 2022] GET /compute/v2.1/servers/b7714792-fa29-4af9-b28a-431c9bb2f5b2 => generated 1192 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:24:08.246679 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b124113d-5f2a-4491-a88f-b6eaa58c9672 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:08.247302 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b124113d-5f2a-4491-a88f-b6eaa58c9672 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:24:08.254610 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b124113d-5f2a-4491-a88f-b6eaa58c9672 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:08.255290 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b124113d-5f2a-4491-a88f-b6eaa58c9672 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:08.255926 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b124113d-5f2a-4491-a88f-b6eaa58c9672 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:08.256377 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b124113d-5f2a-4491-a88f-b6eaa58c9672 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:08.396506 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b124113d-5f2a-4491-a88f-b6eaa58c9672 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:24:08.406775 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b124113d-5f2a-4491-a88f-b6eaa58c9672 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:24:08.408275 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b124113d-5f2a-4491-a88f-b6eaa58c9672 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:24:08.409474 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b124113d-5f2a-4491-a88f-b6eaa58c9672 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1724 microversion: 2.20 time: 0.166748 Jul 28 18:24:08.410017 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 502/1014] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:24:08 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:24:08.749855 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-6b55e987-2fd1-4833-b6eb-9da4063a7b38 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:08.751935 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-6b55e987-2fd1-4833-b6eb-9da4063a7b38 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: b7714792-fa29-4af9-b28a-431c9bb2f5b2] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:24:08.761741 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-6b55e987-2fd1-4833-b6eb-9da4063a7b38 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:08.761741 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-6b55e987-2fd1-4833-b6eb-9da4063a7b38 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:08.764175 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-6b55e987-2fd1-4833-b6eb-9da4063a7b38 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:08.764175 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-6b55e987-2fd1-4833-b6eb-9da4063a7b38 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:08.839509 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-6b55e987-2fd1-4833-b6eb-9da4063a7b38 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:24:08.848108 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-6b55e987-2fd1-4833-b6eb-9da4063a7b38 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/b7714792-fa29-4af9-b28a-431c9bb2f5b2" status: 200 len: 1200 microversion: 2.1 time: 0.103300 Jul 28 18:24:08.861424 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 513/1015] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:24:08 2022] GET /compute/v2.1/servers/b7714792-fa29-4af9-b28a-431c9bb2f5b2 => generated 1200 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:24:09.434159 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-7e3e85d9-d95d-4da6-ab13-b4d536ff0df8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:09.434935 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-7e3e85d9-d95d-4da6-ab13-b4d536ff0df8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:24:09.442291 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7e3e85d9-d95d-4da6-ab13-b4d536ff0df8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:09.442815 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7e3e85d9-d95d-4da6-ab13-b4d536ff0df8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:09.443714 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7e3e85d9-d95d-4da6-ab13-b4d536ff0df8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:09.444247 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7e3e85d9-d95d-4da6-ab13-b4d536ff0df8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:09.871508 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-3c855de6-f8f3-4c9d-a657-a0eb720100bd tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:09.872741 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-3c855de6-f8f3-4c9d-a657-a0eb720100bd tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: b7714792-fa29-4af9-b28a-431c9bb2f5b2] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:24:09.881828 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-3c855de6-f8f3-4c9d-a657-a0eb720100bd tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:09.882525 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-3c855de6-f8f3-4c9d-a657-a0eb720100bd tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:09.883584 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-3c855de6-f8f3-4c9d-a657-a0eb720100bd tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:09.884190 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-3c855de6-f8f3-4c9d-a657-a0eb720100bd tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:09.920010 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-7e3e85d9-d95d-4da6-ab13-b4d536ff0df8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:24:09.928497 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-7e3e85d9-d95d-4da6-ab13-b4d536ff0df8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:24:09.930122 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-7e3e85d9-d95d-4da6-ab13-b4d536ff0df8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:24:09.931217 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-7e3e85d9-d95d-4da6-ab13-b4d536ff0df8 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1724 microversion: 2.20 time: 0.501796 Jul 28 18:24:09.933219 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 503/1016] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:24:09 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1724 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:24:10.243988 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-3c855de6-f8f3-4c9d-a657-a0eb720100bd tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:24:10.249821 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-3c855de6-f8f3-4c9d-a657-a0eb720100bd tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/b7714792-fa29-4af9-b28a-431c9bb2f5b2" status: 200 len: 1277 microversion: 2.1 time: 0.383766 Jul 28 18:24:10.261047 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 514/1017] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:24:09 2022] GET /compute/v2.1/servers/b7714792-fa29-4af9-b28a-431c9bb2f5b2 => generated 1277 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:24:10.960744 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-acd662a7-f1b3-4c67-9960-bd84f20110bf tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:10.962624 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-acd662a7-f1b3-4c67-9960-bd84f20110bf tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:24:10.973250 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-acd662a7-f1b3-4c67-9960-bd84f20110bf tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:10.974653 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-acd662a7-f1b3-4c67-9960-bd84f20110bf tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:10.975941 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-acd662a7-f1b3-4c67-9960-bd84f20110bf tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:10.976700 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-acd662a7-f1b3-4c67-9960-bd84f20110bf tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:11.133112 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-acd662a7-f1b3-4c67-9960-bd84f20110bf tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:24:11.158759 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-acd662a7-f1b3-4c67-9960-bd84f20110bf tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:24:11.167801 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-acd662a7-f1b3-4c67-9960-bd84f20110bf tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:24:11.170581 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-acd662a7-f1b3-4c67-9960-bd84f20110bf tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1656 microversion: 2.20 time: 0.214622 Jul 28 18:24:11.171702 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 515/1018] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:24:10 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1656 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:24:11.177375 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [req-033c3541-e653-4ed1-9972-8070e1abbeee req-f4d89776-1633-4715-a055-82263e89bdfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f14e236-1f43-4ff7-bf3d-ae1f6a084b82", "name": "network-vif-deleted", "tag": "0069c542-1991-42af-bff0-348765fbb55f"}]} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:24:11.200287 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-033c3541-e653-4ed1-9972-8070e1abbeee req-f4d89776-1633-4715-a055-82263e89bdfd service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:11.201269 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-033c3541-e653-4ed1-9972-8070e1abbeee req-f4d89776-1633-4715-a055-82263e89bdfd service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:11.249445 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.compute.server_external_events [req-033c3541-e653-4ed1-9972-8070e1abbeee req-f4d89776-1633-4715-a055-82263e89bdfd service nova] Creating event network-vif-deleted:0069c542-1991-42af-bff0-348765fbb55f for instance 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 on hv-cinder-84617 Jul 28 18:24:11.291298 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [req-033c3541-e653-4ed1-9972-8070e1abbeee req-f4d89776-1633-4715-a055-82263e89bdfd service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110059 Jul 28 18:24:11.291298 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 516/1019] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:24:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:24:11.291298 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-7bc10b00-8396-4b31-8526-c6496377b7b1 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:11.293251 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-7bc10b00-8396-4b31-8526-c6496377b7b1 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: b7714792-fa29-4af9-b28a-431c9bb2f5b2] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:24:11.300173 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-7bc10b00-8396-4b31-8526-c6496377b7b1 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:11.300878 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-7bc10b00-8396-4b31-8526-c6496377b7b1 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:11.301852 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-7bc10b00-8396-4b31-8526-c6496377b7b1 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:11.302726 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-7bc10b00-8396-4b31-8526-c6496377b7b1 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:11.307778 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-d9933b10-313d-4936-a2dd-ecf6d7a87f3d req-7f822479-de19-44e4-861c-f5df3d0b00ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7714792-fa29-4af9-b28a-431c9bb2f5b2", "tag": "019e5716-7cc7-4c8a-b0a4-f7f4aab4034a"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:24:11.330692 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-d9933b10-313d-4936-a2dd-ecf6d7a87f3d req-7f822479-de19-44e4-861c-f5df3d0b00ba service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:11.331143 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-d9933b10-313d-4936-a2dd-ecf6d7a87f3d req-7f822479-de19-44e4-861c-f5df3d0b00ba service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:11.368109 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-d9933b10-313d-4936-a2dd-ecf6d7a87f3d req-7f822479-de19-44e4-861c-f5df3d0b00ba service nova] Creating event network-changed:019e5716-7cc7-4c8a-b0a4-f7f4aab4034a for instance b7714792-fa29-4af9-b28a-431c9bb2f5b2 on hv-cinder-84617 Jul 28 18:24:11.377460 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-d9933b10-313d-4936-a2dd-ecf6d7a87f3d req-7f822479-de19-44e4-861c-f5df3d0b00ba service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.503715 Jul 28 18:24:11.378586 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 504/1020] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:24:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:24:11.547951 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-7bc10b00-8396-4b31-8526-c6496377b7b1 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:24:11.556056 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-7bc10b00-8396-4b31-8526-c6496377b7b1 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/b7714792-fa29-4af9-b28a-431c9bb2f5b2" status: 200 len: 1265 microversion: 2.1 time: 0.270736 Jul 28 18:24:11.561638 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 517/1021] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:24:11 2022] GET /compute/v2.1/servers/b7714792-fa29-4af9-b28a-431c9bb2f5b2 => generated 1265 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:24:12.199848 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-7e3a49c9-1c82-41d1-bdc5-20f26162d898 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:12.200540 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-7e3a49c9-1c82-41d1-bdc5-20f26162d898 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:24:12.206899 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7e3a49c9-1c82-41d1-bdc5-20f26162d898 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:12.208818 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7e3a49c9-1c82-41d1-bdc5-20f26162d898 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:12.208818 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7e3a49c9-1c82-41d1-bdc5-20f26162d898 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:12.208818 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7e3a49c9-1c82-41d1-bdc5-20f26162d898 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:12.247348 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7e3a49c9-1c82-41d1-bdc5-20f26162d898 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:12.248111 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7e3a49c9-1c82-41d1-bdc5-20f26162d898 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:12.248758 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.objects.instance [None req-7e3a49c9-1c82-41d1-bdc5-20f26162d898 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lazy-loading 'fault' on Instance uuid 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 {{(pid=118453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:24:12.294323 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-7e3a49c9-1c82-41d1-bdc5-20f26162d898 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:24:12.302451 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-7e3a49c9-1c82-41d1-bdc5-20f26162d898 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:24:12.303939 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-7e3a49c9-1c82-41d1-bdc5-20f26162d898 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:24:12.305120 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-7e3a49c9-1c82-41d1-bdc5-20f26162d898 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1372 microversion: 2.20 time: 0.110077 Jul 28 18:24:12.305674 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 505/1022] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:24:12 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1372 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:24:12.580116 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-3a6914b7-14ac-4c01-a338-5891d90b3560 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:12.580796 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-3a6914b7-14ac-4c01-a338-5891d90b3560 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: b7714792-fa29-4af9-b28a-431c9bb2f5b2] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:24:12.587550 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-3a6914b7-14ac-4c01-a338-5891d90b3560 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:12.587995 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-3a6914b7-14ac-4c01-a338-5891d90b3560 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:12.588759 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-3a6914b7-14ac-4c01-a338-5891d90b3560 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:12.589222 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-3a6914b7-14ac-4c01-a338-5891d90b3560 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:12.728337 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-3a6914b7-14ac-4c01-a338-5891d90b3560 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:24:12.736049 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-3a6914b7-14ac-4c01-a338-5891d90b3560 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/b7714792-fa29-4af9-b28a-431c9bb2f5b2" status: 200 len: 1265 microversion: 2.1 time: 0.159934 Jul 28 18:24:12.736614 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 518/1023] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:24:12 2022] GET /compute/v2.1/servers/b7714792-fa29-4af9-b28a-431c9bb2f5b2 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:24:13.328155 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-4ed8a78d-0218-410a-9104-d4f2b98192a6 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:13.328808 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-4ed8a78d-0218-410a-9104-d4f2b98192a6 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:24:13.336206 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4ed8a78d-0218-410a-9104-d4f2b98192a6 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:13.336666 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4ed8a78d-0218-410a-9104-d4f2b98192a6 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:13.337497 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4ed8a78d-0218-410a-9104-d4f2b98192a6 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:13.337945 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4ed8a78d-0218-410a-9104-d4f2b98192a6 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:13.369932 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4ed8a78d-0218-410a-9104-d4f2b98192a6 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:13.370389 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4ed8a78d-0218-410a-9104-d4f2b98192a6 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:13.370848 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.objects.instance [None req-4ed8a78d-0218-410a-9104-d4f2b98192a6 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lazy-loading 'fault' on Instance uuid 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 {{(pid=118453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:24:13.418983 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-4ed8a78d-0218-410a-9104-d4f2b98192a6 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:24:13.427056 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-4ed8a78d-0218-410a-9104-d4f2b98192a6 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:24:13.428673 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-4ed8a78d-0218-410a-9104-d4f2b98192a6 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca7d773290a9483d91ebefad341addee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e962e97777048b79415ba13adcc95be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:24:13.429961 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-4ed8a78d-0218-410a-9104-d4f2b98192a6 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 200 len: 1372 microversion: 2.20 time: 0.106013 Jul 28 18:24:13.440844 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 506/1024] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:24:13 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 1372 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:24:13.756365 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-05ada3a3-07b5-4caf-9d0e-4b77892effdf tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:13.757003 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-05ada3a3-07b5-4caf-9d0e-4b77892effdf tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: b7714792-fa29-4af9-b28a-431c9bb2f5b2] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:24:13.764186 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-05ada3a3-07b5-4caf-9d0e-4b77892effdf tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:13.764690 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-05ada3a3-07b5-4caf-9d0e-4b77892effdf tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:13.765481 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-05ada3a3-07b5-4caf-9d0e-4b77892effdf tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:13.765920 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-05ada3a3-07b5-4caf-9d0e-4b77892effdf tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:13.901625 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-05ada3a3-07b5-4caf-9d0e-4b77892effdf tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:24:13.909079 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-05ada3a3-07b5-4caf-9d0e-4b77892effdf tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/b7714792-fa29-4af9-b28a-431c9bb2f5b2" status: 200 len: 1265 microversion: 2.1 time: 0.156713 Jul 28 18:24:13.909650 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 519/1025] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:24:13 2022] GET /compute/v2.1/servers/b7714792-fa29-4af9-b28a-431c9bb2f5b2 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:24:14.452176 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-6fc500a4-9a26-476f-af7e-5ce2379eab96 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:14.452781 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-6fc500a4-9a26-476f-af7e-5ce2379eab96 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:24:14.459229 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6fc500a4-9a26-476f-af7e-5ce2379eab96 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:14.459684 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6fc500a4-9a26-476f-af7e-5ce2379eab96 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:14.461328 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6fc500a4-9a26-476f-af7e-5ce2379eab96 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:14.461328 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6fc500a4-9a26-476f-af7e-5ce2379eab96 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:14.474199 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.wsgi [None req-6fc500a4-9a26-476f-af7e-5ce2379eab96 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] HTTP exception thrown: Instance 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 could not be found. Jul 28 18:24:14.475826 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-6fc500a4-9a26-476f-af7e-5ce2379eab96 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Request method failure captured: Jul 28 18:24:14.475826 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: request: GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 HTTP/1.1 Jul 28 18:24:14.475826 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Accept: application/json Jul 28 18:24:14.475826 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Accept-Encoding: identity Jul 28 18:24:14.475826 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Connection: close Jul 28 18:24:14.475826 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Content-Length: 0 Jul 28 18:24:14.475826 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Content-Type: application/json Jul 28 18:24:14.475826 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Host: 10.222.0.86 Jul 28 18:24:14.475826 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Openstack-System-Scope: None Jul 28 18:24:14.475826 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: User-Agent: python-urllib3/1.26.10 Jul 28 18:24:14.475826 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Auth-Token: gAAAAABi4tGYtri9w88fvm9LdwZ9q5eT8OemXnJrGThiFt_Jy7tnSkbCyYLecvfGGXcIDWtA5RcE8mn3rAtlD95iEejdxlDLjKdZ6FTdXo73WOMqFIz_TEcxTWtQAJ9fBowbsqs0rahQu51tqhBl7gHiC-szGsusyvQggLBcC5r-9AfeERA-cPc Jul 28 18:24:14.475826 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Domain-Id: None Jul 28 18:24:14.475826 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Domain-Name: None Jul 28 18:24:14.475826 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Identity-Status: Confirmed Jul 28 18:24:14.475826 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Is-Admin-Project: True Jul 28 18:24:14.475826 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 18:24:14.475826 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Id: default Jul 28 18:24:14.475826 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Name: Default Jul 28 18:24:14.475826 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Id: 9e962e97777048b79415ba13adcc95be Jul 28 18:24:14.475826 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-64193895 Jul 28 18:24:14.475826 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Role: member,reader Jul 28 18:24:14.475826 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Roles: member,reader Jul 28 18:24:14.477629 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_9e962e97777048b79415ba13adcc95be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/9e962e97777048b79415ba13adcc95be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/9e962e97777048b79415ba13adcc95be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/9e962e97777048b79415ba13adcc95be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}] Jul 28 18:24:14.477629 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant: tempest-AttachVolumeShelveTestJSON-64193895 Jul 28 18:24:14.477629 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant-Id: 9e962e97777048b79415ba13adcc95be Jul 28 18:24:14.477629 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-64193895 Jul 28 18:24:14.477629 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User: tempest-AttachVolumeShelveTestJSON-64193895-project Jul 28 18:24:14.477629 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Id: default Jul 28 18:24:14.477629 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Name: Default Jul 28 18:24:14.477629 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Id: ca7d773290a9483d91ebefad341addee Jul 28 18:24:14.477629 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Name: tempest-AttachVolumeShelveTestJSON-64193895-project Jul 28 18:24:14.477629 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: method: > Jul 28 18:24:14.477629 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: exception: Instance 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 could not be found. Jul 28 18:24:14.477629 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: action_args: {'id': '3f14e236-1f43-4ff7-bf3d-ae1f6a084b82'} Jul 28 18:24:14.478577 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:24:14.478577 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:24:14.478577 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:24:14.478577 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:24:14.478577 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:24:14.478577 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:24:14.478577 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:24:14.478577 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:24:14.478577 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:24:14.478577 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:24:14.478577 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 could not be found. Jul 28 18:24:14.478577 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:24:14.478577 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:24:14.478577 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:24:14.478577 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:24:14.478577 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:24:14.478577 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:24:14.478577 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:24:14.478577 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:24:14.478577 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:24:14.480628 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:24:14.480628 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 18:24:14.480628 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 18:24:14.480628 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:24:14.480628 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:24:14.480628 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:24:14.480628 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:24:14.480628 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 could not be found. Jul 28 18:24:14.480628 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:24:14.480628 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:24:14.480628 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:24:14.480628 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:24:14.480628 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:24:14.480628 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:24:14.480628 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:24:14.480628 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:24:14.480628 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 could not be found. Jul 28 18:24:14.480628 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:24:14.486916 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-6fc500a4-9a26-476f-af7e-5ce2379eab96 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Returning 404 to user: Instance 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 could not be found. {{(pid=118453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:24:14.486916 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-6fc500a4-9a26-476f-af7e-5ce2379eab96 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 404 len: 111 microversion: 2.20 time: 0.029031 Jul 28 18:24:14.486916 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 507/1026] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:24:14 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 18:24:14.487176 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-461df5c1-7c7b-4efe-bb35-658ed1eb970b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '.version_select at 0x7f6fe265a160>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:14.491122 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR oslo.messaging._drivers.impl_rabbit [None req-461df5c1-7c7b-4efe-bb35-658ed1eb970b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [1f036f57-13ae-4f9e-b66e-a4a1464a984c] AMQP server on 10.222.0.86:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 28 18:24:14.929614 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d67d9d4a-e34e-4dcc-9ab9-c4e4e454d2a6 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:14.930227 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-d67d9d4a-e34e-4dcc-9ab9-c4e4e454d2a6 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: b7714792-fa29-4af9-b28a-431c9bb2f5b2] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:24:14.936792 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d67d9d4a-e34e-4dcc-9ab9-c4e4e454d2a6 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:14.937278 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d67d9d4a-e34e-4dcc-9ab9-c4e4e454d2a6 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:14.938053 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d67d9d4a-e34e-4dcc-9ab9-c4e4e454d2a6 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:14.938495 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d67d9d4a-e34e-4dcc-9ab9-c4e4e454d2a6 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:14.968637 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell0:SELECT=2 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:24:14.990248 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell0:SELECT=6 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:24:15.068478 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-d67d9d4a-e34e-4dcc-9ab9-c4e4e454d2a6 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:24:15.076208 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-d67d9d4a-e34e-4dcc-9ab9-c4e4e454d2a6 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/b7714792-fa29-4af9-b28a-431c9bb2f5b2" status: 200 len: 1265 microversion: 2.1 time: 0.150437 Jul 28 18:24:15.076651 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 508/1027] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:24:14 2022] GET /compute/v2.1/servers/b7714792-fa29-4af9-b28a-431c9bb2f5b2 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:24:15.164299 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-4eb4b3cd-a684-4d0a-a3c3-630f58e65b1e tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-120466338", "imageRef": "61912422-61cd-4ced-a573-85ee305e010f", "flavorRef": "452"}} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:24:15.215375 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.network.neutron [None req-4eb4b3cd-a684-4d0a-a3c3-630f58e65b1e tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] validate_networks() for None {{(pid=118453) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 18:24:15.487432 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-4eb4b3cd-a684-4d0a-a3c3-630f58e65b1e tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Flavor limits 0:0:0 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 18:24:15.488015 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-4eb4b3cd-a684-4d0a-a3c3-630f58e65b1e tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Image limits 0:0:0 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 18:24:15.488302 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-4eb4b3cd-a684-4d0a-a3c3-630f58e65b1e tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Flavor pref 0:0:0 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 18:24:15.488709 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-4eb4b3cd-a684-4d0a-a3c3-630f58e65b1e tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Image pref 0:0:0 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 18:24:15.489189 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-4eb4b3cd-a684-4d0a-a3c3-630f58e65b1e tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 18:24:15.498289 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO oslo.messaging._drivers.impl_rabbit [None req-461df5c1-7c7b-4efe-bb35-658ed1eb970b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [1f036f57-13ae-4f9e-b66e-a4a1464a984c] Reconnected to AMQP server on 10.222.0.86:5672 via [amqp] client with port 54162. Jul 28 18:24:15.499177 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4eb4b3cd-a684-4d0a-a3c3-630f58e65b1e tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:15.499636 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4eb4b3cd-a684-4d0a-a3c3-630f58e65b1e tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:15.500476 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4eb4b3cd-a684-4d0a-a3c3-630f58e65b1e tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:15.500919 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4eb4b3cd-a684-4d0a-a3c3-630f58e65b1e tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:15.517537 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.quota [None req-4eb4b3cd-a684-4d0a-a3c3-630f58e65b1e tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Getting quotas for project fa13cc57b22c438b842a59ff4e207f10. Resources: {'cores', 'ram', 'instances'} {{(pid=118453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 18:24:15.525399 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.quota [None req-4eb4b3cd-a684-4d0a-a3c3-630f58e65b1e tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Getting quotas for user f30ea147cc194c2f84add802a6ff624f and project fa13cc57b22c438b842a59ff4e207f10. Resources: {'cores', 'ram', 'instances'} {{(pid=118453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 18:24:15.533146 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-4eb4b3cd-a684-4d0a-a3c3-630f58e65b1e tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Going to run 1 instances... {{(pid=118453) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 18:24:15.535408 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-4eb4b3cd-a684-4d0a-a3c3-630f58e65b1e tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] [instance: 85b39e0f-e599-49d0-9e3f-d9f74f0f4770] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='61912422-61cd-4ced-a573-85ee305e010f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 18:24:15.573835 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-461df5c1-7c7b-4efe-bb35-658ed1eb970b tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1362015628" status: 204 len: 0 microversion: 2.20 time: 1.090985 Jul 28 18:24:15.574427 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 520/1028] 10.222.0.86 () {60 vars in 1262 bytes} [Thu Jul 28 18:24:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1362015628 => generated 0 bytes in 1092 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 18:24:15.693684 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-4eb4b3cd-a684-4d0a-a3c3-630f58e65b1e tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.533047 Jul 28 18:24:15.694242 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 509/1029] 10.222.0.86 () {60 vars in 1147 bytes} [Thu Jul 28 18:24:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 534 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 18:24:15.705132 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-cbc07045-0c96-4c9f-975f-5fdf4311d688 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:15.705755 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-cbc07045-0c96-4c9f-975f-5fdf4311d688 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] [instance: 85b39e0f-e599-49d0-9e3f-d9f74f0f4770] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:24:15.761905 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-cbc07045-0c96-4c9f-975f-5fdf4311d688 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f30ea147cc194c2f84add802a6ff624f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa13cc57b22c438b842a59ff4e207f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:24:15.769296 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-cbc07045-0c96-4c9f-975f-5fdf4311d688 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] 10.222.0.86 "GET /compute/v2.1/servers/85b39e0f-e599-49d0-9e3f-d9f74f0f4770" status: 200 len: 1214 microversion: 2.1 time: 0.068069 Jul 28 18:24:15.769907 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 521/1030] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:24:15 2022] GET /compute/v2.1/servers/85b39e0f-e599-49d0-9e3f-d9f74f0f4770 => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:24:16.097292 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-4e522c44-f0c8-4a13-ac39-dd0cc3482a29 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:16.098201 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-4e522c44-f0c8-4a13-ac39-dd0cc3482a29 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: b7714792-fa29-4af9-b28a-431c9bb2f5b2] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:24:16.107024 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4e522c44-f0c8-4a13-ac39-dd0cc3482a29 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:16.107560 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4e522c44-f0c8-4a13-ac39-dd0cc3482a29 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:16.108325 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4e522c44-f0c8-4a13-ac39-dd0cc3482a29 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:16.108766 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4e522c44-f0c8-4a13-ac39-dd0cc3482a29 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:16.263230 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-4e522c44-f0c8-4a13-ac39-dd0cc3482a29 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:24:16.273294 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-4e522c44-f0c8-4a13-ac39-dd0cc3482a29 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/b7714792-fa29-4af9-b28a-431c9bb2f5b2" status: 200 len: 1265 microversion: 2.1 time: 0.180044 Jul 28 18:24:16.273937 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 510/1031] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:24:16 2022] GET /compute/v2.1/servers/b7714792-fa29-4af9-b28a-431c9bb2f5b2 => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:24:16.793802 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-cad0c7c1-53a0-453f-b056-633214678fa8 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:16.794369 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-cad0c7c1-53a0-453f-b056-633214678fa8 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] [instance: 85b39e0f-e599-49d0-9e3f-d9f74f0f4770] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:24:16.848201 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-cad0c7c1-53a0-453f-b056-633214678fa8 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f30ea147cc194c2f84add802a6ff624f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa13cc57b22c438b842a59ff4e207f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:24:16.854909 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-cad0c7c1-53a0-453f-b056-633214678fa8 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] 10.222.0.86 "GET /compute/v2.1/servers/85b39e0f-e599-49d0-9e3f-d9f74f0f4770" status: 200 len: 1214 microversion: 2.1 time: 0.065154 Jul 28 18:24:16.855465 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 522/1032] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:24:16 2022] GET /compute/v2.1/servers/85b39e0f-e599-49d0-9e3f-d9f74f0f4770 => generated 1214 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:24:17.295401 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-71a36a3f-0227-4718-91ae-fd66a7c02f32 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:17.296017 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-71a36a3f-0227-4718-91ae-fd66a7c02f32 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: b7714792-fa29-4af9-b28a-431c9bb2f5b2] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:24:17.302620 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-71a36a3f-0227-4718-91ae-fd66a7c02f32 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:17.303073 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-71a36a3f-0227-4718-91ae-fd66a7c02f32 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:17.303847 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-71a36a3f-0227-4718-91ae-fd66a7c02f32 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:17.307623 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-71a36a3f-0227-4718-91ae-fd66a7c02f32 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:17.438814 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-71a36a3f-0227-4718-91ae-fd66a7c02f32 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:24:17.446261 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-71a36a3f-0227-4718-91ae-fd66a7c02f32 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/b7714792-fa29-4af9-b28a-431c9bb2f5b2" status: 200 len: 1265 microversion: 2.1 time: 0.155556 Jul 28 18:24:17.446820 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 511/1033] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:24:17 2022] GET /compute/v2.1/servers/b7714792-fa29-4af9-b28a-431c9bb2f5b2 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:24:17.781732 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-8df2d5ee-f4ec-4653-8663-2178e9a4b148 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:17.782237 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-8df2d5ee-f4ec-4653-8663-2178e9a4b148 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:24:17.788426 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-8df2d5ee-f4ec-4653-8663-2178e9a4b148 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:17.788876 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-8df2d5ee-f4ec-4653-8663-2178e9a4b148 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:17.789676 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-8df2d5ee-f4ec-4653-8663-2178e9a4b148 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:17.790118 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-8df2d5ee-f4ec-4653-8663-2178e9a4b148 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:17.804284 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.wsgi [None req-8df2d5ee-f4ec-4653-8663-2178e9a4b148 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] HTTP exception thrown: Instance 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 could not be found. Jul 28 18:24:17.806176 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-8df2d5ee-f4ec-4653-8663-2178e9a4b148 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Request method failure captured: Jul 28 18:24:17.806176 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: request: DELETE /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 HTTP/1.1 Jul 28 18:24:17.806176 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Accept: application/json Jul 28 18:24:17.806176 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Accept-Encoding: identity Jul 28 18:24:17.806176 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Connection: close Jul 28 18:24:17.806176 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Content-Length: 0 Jul 28 18:24:17.806176 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Content-Type: application/json Jul 28 18:24:17.806176 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Host: 10.222.0.86 Jul 28 18:24:17.806176 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Openstack-System-Scope: None Jul 28 18:24:17.806176 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: User-Agent: python-urllib3/1.26.10 Jul 28 18:24:17.806176 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Auth-Token: gAAAAABi4tGYtri9w88fvm9LdwZ9q5eT8OemXnJrGThiFt_Jy7tnSkbCyYLecvfGGXcIDWtA5RcE8mn3rAtlD95iEejdxlDLjKdZ6FTdXo73WOMqFIz_TEcxTWtQAJ9fBowbsqs0rahQu51tqhBl7gHiC-szGsusyvQggLBcC5r-9AfeERA-cPc Jul 28 18:24:17.806176 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Domain-Id: None Jul 28 18:24:17.806176 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Domain-Name: None Jul 28 18:24:17.806176 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Identity-Status: Confirmed Jul 28 18:24:17.806176 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Is-Admin-Project: True Jul 28 18:24:17.806176 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 18:24:17.806176 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Domain-Id: default Jul 28 18:24:17.806176 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Domain-Name: Default Jul 28 18:24:17.806176 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Id: 9e962e97777048b79415ba13adcc95be Jul 28 18:24:17.806176 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-64193895 Jul 28 18:24:17.806176 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Role: member,reader Jul 28 18:24:17.806176 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Roles: member,reader Jul 28 18:24:17.808359 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_9e962e97777048b79415ba13adcc95be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/9e962e97777048b79415ba13adcc95be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/9e962e97777048b79415ba13adcc95be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/9e962e97777048b79415ba13adcc95be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}] Jul 28 18:24:17.808359 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant: tempest-AttachVolumeShelveTestJSON-64193895 Jul 28 18:24:17.808359 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant-Id: 9e962e97777048b79415ba13adcc95be Jul 28 18:24:17.808359 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-64193895 Jul 28 18:24:17.808359 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User: tempest-AttachVolumeShelveTestJSON-64193895-project Jul 28 18:24:17.808359 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Domain-Id: default Jul 28 18:24:17.808359 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Domain-Name: Default Jul 28 18:24:17.808359 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Id: ca7d773290a9483d91ebefad341addee Jul 28 18:24:17.808359 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Name: tempest-AttachVolumeShelveTestJSON-64193895-project Jul 28 18:24:17.808359 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: method: > Jul 28 18:24:17.808359 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: exception: Instance 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 could not be found. Jul 28 18:24:17.808359 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: action_args: {'id': '3f14e236-1f43-4ff7-bf3d-ae1f6a084b82'} Jul 28 18:24:17.809204 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:24:17.809204 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:24:17.809204 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:24:17.809204 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:24:17.809204 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:24:17.809204 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:24:17.809204 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:24:17.809204 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:24:17.809204 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:24:17.809204 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:24:17.809204 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 could not be found. Jul 28 18:24:17.809204 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:24:17.809204 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:24:17.809204 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:24:17.809204 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:24:17.809204 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:24:17.809204 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:24:17.809204 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:24:17.809204 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:24:17.809204 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:24:17.810783 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:24:17.810783 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 18:24:17.810783 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 18:24:17.810783 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 18:24:17.810783 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 18:24:17.810783 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:24:17.810783 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:24:17.810783 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:24:17.810783 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:24:17.810783 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 could not be found. Jul 28 18:24:17.810783 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:24:17.810783 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:24:17.810783 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:24:17.810783 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:24:17.810783 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:24:17.810783 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:24:17.810783 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:24:17.810783 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:24:17.810783 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 could not be found. Jul 28 18:24:17.810783 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:24:17.812226 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-8df2d5ee-f4ec-4653-8663-2178e9a4b148 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Returning 404 to user: Instance 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 could not be found. {{(pid=118454) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:24:17.812226 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-8df2d5ee-f4ec-4653-8663-2178e9a4b148 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "DELETE /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 404 len: 111 microversion: 2.20 time: 0.030316 Jul 28 18:24:17.812226 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 523/1034] 10.222.0.86 () {60 vars in 1280 bytes} [Thu Jul 28 18:24:17 2022] DELETE /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 18:24:17.817224 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b9c249ae-8c38-4bef-8c6e-b6654d05a7e0 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:17.817862 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b9c249ae-8c38-4bef-8c6e-b6654d05a7e0 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:24:17.824774 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b9c249ae-8c38-4bef-8c6e-b6654d05a7e0 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:17.825247 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b9c249ae-8c38-4bef-8c6e-b6654d05a7e0 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:17.826005 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b9c249ae-8c38-4bef-8c6e-b6654d05a7e0 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:17.826438 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b9c249ae-8c38-4bef-8c6e-b6654d05a7e0 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:17.839802 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.wsgi [None req-b9c249ae-8c38-4bef-8c6e-b6654d05a7e0 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] HTTP exception thrown: Instance 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 could not be found. Jul 28 18:24:17.841346 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b9c249ae-8c38-4bef-8c6e-b6654d05a7e0 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Request method failure captured: Jul 28 18:24:17.841346 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: request: GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 HTTP/1.1 Jul 28 18:24:17.841346 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Accept: application/json Jul 28 18:24:17.841346 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Accept-Encoding: identity Jul 28 18:24:17.841346 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Connection: close Jul 28 18:24:17.841346 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Content-Length: 0 Jul 28 18:24:17.841346 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Content-Type: application/json Jul 28 18:24:17.841346 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Host: 10.222.0.86 Jul 28 18:24:17.841346 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Openstack-System-Scope: None Jul 28 18:24:17.841346 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: User-Agent: python-urllib3/1.26.10 Jul 28 18:24:17.841346 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Auth-Token: gAAAAABi4tGYtri9w88fvm9LdwZ9q5eT8OemXnJrGThiFt_Jy7tnSkbCyYLecvfGGXcIDWtA5RcE8mn3rAtlD95iEejdxlDLjKdZ6FTdXo73WOMqFIz_TEcxTWtQAJ9fBowbsqs0rahQu51tqhBl7gHiC-szGsusyvQggLBcC5r-9AfeERA-cPc Jul 28 18:24:17.841346 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Domain-Id: None Jul 28 18:24:17.841346 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Domain-Name: None Jul 28 18:24:17.841346 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Identity-Status: Confirmed Jul 28 18:24:17.841346 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Is-Admin-Project: True Jul 28 18:24:17.841346 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 18:24:17.841346 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Id: default Jul 28 18:24:17.841346 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Name: Default Jul 28 18:24:17.841346 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Id: 9e962e97777048b79415ba13adcc95be Jul 28 18:24:17.841346 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-64193895 Jul 28 18:24:17.841346 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Role: member,reader Jul 28 18:24:17.841346 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Roles: member,reader Jul 28 18:24:17.843032 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_9e962e97777048b79415ba13adcc95be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/9e962e97777048b79415ba13adcc95be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/9e962e97777048b79415ba13adcc95be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/9e962e97777048b79415ba13adcc95be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}] Jul 28 18:24:17.843032 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant: tempest-AttachVolumeShelveTestJSON-64193895 Jul 28 18:24:17.843032 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant-Id: 9e962e97777048b79415ba13adcc95be Jul 28 18:24:17.843032 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-64193895 Jul 28 18:24:17.843032 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User: tempest-AttachVolumeShelveTestJSON-64193895-project Jul 28 18:24:17.843032 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Id: default Jul 28 18:24:17.843032 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Name: Default Jul 28 18:24:17.843032 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Id: ca7d773290a9483d91ebefad341addee Jul 28 18:24:17.843032 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Name: tempest-AttachVolumeShelveTestJSON-64193895-project Jul 28 18:24:17.843032 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: method: > Jul 28 18:24:17.843032 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: exception: Instance 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 could not be found. Jul 28 18:24:17.843032 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: action_args: {'id': '3f14e236-1f43-4ff7-bf3d-ae1f6a084b82'} Jul 28 18:24:17.843980 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:24:17.843980 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:24:17.843980 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:24:17.843980 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:24:17.843980 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:24:17.843980 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:24:17.843980 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:24:17.843980 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:24:17.843980 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:24:17.843980 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:24:17.843980 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 could not be found. Jul 28 18:24:17.843980 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:24:17.843980 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:24:17.843980 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:24:17.843980 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:24:17.843980 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:24:17.843980 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:24:17.843980 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:24:17.843980 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:24:17.843980 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:24:17.845505 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:24:17.845505 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 18:24:17.845505 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 18:24:17.845505 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:24:17.845505 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:24:17.845505 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:24:17.845505 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:24:17.845505 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 could not be found. Jul 28 18:24:17.845505 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:24:17.845505 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:24:17.845505 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:24:17.845505 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:24:17.845505 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:24:17.845505 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:24:17.845505 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:24:17.845505 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:24:17.845505 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 could not be found. Jul 28 18:24:17.845505 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:24:17.850488 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b9c249ae-8c38-4bef-8c6e-b6654d05a7e0 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Returning 404 to user: Instance 3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 could not be found. {{(pid=118453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:24:17.850488 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b9c249ae-8c38-4bef-8c6e-b6654d05a7e0 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82" status: 404 len: 111 microversion: 2.20 time: 0.029756 Jul 28 18:24:17.850488 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 512/1035] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:24:17 2022] GET /compute/v2.1/servers/3f14e236-1f43-4ff7-bf3d-ae1f6a084b82 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 18:24:17.877564 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-123c2efa-2d8b-40bd-90c2-e97463ca3281 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:17.878189 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-123c2efa-2d8b-40bd-90c2-e97463ca3281 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] [instance: 85b39e0f-e599-49d0-9e3f-d9f74f0f4770] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:24:17.884371 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-123c2efa-2d8b-40bd-90c2-e97463ca3281 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:17.884797 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-123c2efa-2d8b-40bd-90c2-e97463ca3281 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:17.886286 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-123c2efa-2d8b-40bd-90c2-e97463ca3281 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:17.886729 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-123c2efa-2d8b-40bd-90c2-e97463ca3281 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:17.954192 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-123c2efa-2d8b-40bd-90c2-e97463ca3281 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f30ea147cc194c2f84add802a6ff624f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa13cc57b22c438b842a59ff4e207f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:24:17.961832 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-123c2efa-2d8b-40bd-90c2-e97463ca3281 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] 10.222.0.86 "GET /compute/v2.1/servers/85b39e0f-e599-49d0-9e3f-d9f74f0f4770" status: 200 len: 1266 microversion: 2.1 time: 0.089352 Jul 28 18:24:17.962388 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 524/1036] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:24:17 2022] GET /compute/v2.1/servers/85b39e0f-e599-49d0-9e3f-d9f74f0f4770 => generated 1266 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:24:18.467774 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-87a30eeb-f8b4-486d-b8fa-1bcc080d1d63 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:18.468382 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-87a30eeb-f8b4-486d-b8fa-1bcc080d1d63 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: b7714792-fa29-4af9-b28a-431c9bb2f5b2] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:24:18.474882 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-87a30eeb-f8b4-486d-b8fa-1bcc080d1d63 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:18.475331 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-87a30eeb-f8b4-486d-b8fa-1bcc080d1d63 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:18.476090 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-87a30eeb-f8b4-486d-b8fa-1bcc080d1d63 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:18.476526 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-87a30eeb-f8b4-486d-b8fa-1bcc080d1d63 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:18.627330 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-87a30eeb-f8b4-486d-b8fa-1bcc080d1d63 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:24:18.630552 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-87a30eeb-f8b4-486d-b8fa-1bcc080d1d63 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/b7714792-fa29-4af9-b28a-431c9bb2f5b2" status: 200 len: 1265 microversion: 2.1 time: 0.167150 Jul 28 18:24:18.631123 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 513/1037] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:24:18 2022] GET /compute/v2.1/servers/b7714792-fa29-4af9-b28a-431c9bb2f5b2 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:24:18.982802 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-e85c9000-90b5-4308-ba07-44ee1ffc234a tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:18.983424 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-e85c9000-90b5-4308-ba07-44ee1ffc234a tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] [instance: 85b39e0f-e599-49d0-9e3f-d9f74f0f4770] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:24:18.989985 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e85c9000-90b5-4308-ba07-44ee1ffc234a tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:18.990442 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e85c9000-90b5-4308-ba07-44ee1ffc234a tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:18.991259 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e85c9000-90b5-4308-ba07-44ee1ffc234a tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:18.991719 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e85c9000-90b5-4308-ba07-44ee1ffc234a tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:19.219788 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-66197fc1-8f1f-41e4-b80d-c3fd088c8d20 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:19.220516 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-66197fc1-8f1f-41e4-b80d-c3fd088c8d20 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:24:19.228320 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-66197fc1-8f1f-41e4-b80d-c3fd088c8d20 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:19.229055 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-66197fc1-8f1f-41e4-b80d-c3fd088c8d20 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:19.229642 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-e85c9000-90b5-4308-ba07-44ee1ffc234a tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f30ea147cc194c2f84add802a6ff624f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa13cc57b22c438b842a59ff4e207f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:24:19.230030 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-66197fc1-8f1f-41e4-b80d-c3fd088c8d20 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:19.230532 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-66197fc1-8f1f-41e4-b80d-c3fd088c8d20 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:19.241119 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-e85c9000-90b5-4308-ba07-44ee1ffc234a tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] 10.222.0.86 "GET /compute/v2.1/servers/85b39e0f-e599-49d0-9e3f-d9f74f0f4770" status: 200 len: 1314 microversion: 2.1 time: 0.261903 Jul 28 18:24:19.300146 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 525/1038] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:24:18 2022] GET /compute/v2.1/servers/85b39e0f-e599-49d0-9e3f-d9f74f0f4770 => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:24:19.301971 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.wsgi [None req-66197fc1-8f1f-41e4-b80d-c3fd088c8d20 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] HTTP exception thrown: Instance 2b1c63c9-4f4b-4c9e-91da-42f88fd63286 could not be found. Jul 28 18:24:19.301971 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-66197fc1-8f1f-41e4-b80d-c3fd088c8d20 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Request method failure captured: Jul 28 18:24:19.301971 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: request: DELETE /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 HTTP/1.1 Jul 28 18:24:19.301971 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Accept: application/json Jul 28 18:24:19.301971 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Accept-Encoding: identity Jul 28 18:24:19.301971 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Connection: close Jul 28 18:24:19.301971 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Content-Length: 0 Jul 28 18:24:19.301971 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Content-Type: application/json Jul 28 18:24:19.301971 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Host: 10.222.0.86 Jul 28 18:24:19.301971 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Openstack-System-Scope: None Jul 28 18:24:19.301971 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: User-Agent: python-urllib3/1.26.10 Jul 28 18:24:19.301971 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Auth-Token: gAAAAABi4tGYtri9w88fvm9LdwZ9q5eT8OemXnJrGThiFt_Jy7tnSkbCyYLecvfGGXcIDWtA5RcE8mn3rAtlD95iEejdxlDLjKdZ6FTdXo73WOMqFIz_TEcxTWtQAJ9fBowbsqs0rahQu51tqhBl7gHiC-szGsusyvQggLBcC5r-9AfeERA-cPc Jul 28 18:24:19.301971 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Domain-Id: None Jul 28 18:24:19.301971 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Domain-Name: None Jul 28 18:24:19.301971 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Identity-Status: Confirmed Jul 28 18:24:19.301971 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Is-Admin-Project: True Jul 28 18:24:19.301971 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 18:24:19.301971 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Id: default Jul 28 18:24:19.301971 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Name: Default Jul 28 18:24:19.301971 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Id: 9e962e97777048b79415ba13adcc95be Jul 28 18:24:19.301971 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-64193895 Jul 28 18:24:19.301971 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Role: member,reader Jul 28 18:24:19.301971 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Roles: member,reader Jul 28 18:24:19.304413 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_9e962e97777048b79415ba13adcc95be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/9e962e97777048b79415ba13adcc95be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/9e962e97777048b79415ba13adcc95be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/9e962e97777048b79415ba13adcc95be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}] Jul 28 18:24:19.304413 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant: tempest-AttachVolumeShelveTestJSON-64193895 Jul 28 18:24:19.304413 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant-Id: 9e962e97777048b79415ba13adcc95be Jul 28 18:24:19.304413 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-64193895 Jul 28 18:24:19.304413 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User: tempest-AttachVolumeShelveTestJSON-64193895-project Jul 28 18:24:19.304413 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Id: default Jul 28 18:24:19.304413 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Name: Default Jul 28 18:24:19.304413 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Id: ca7d773290a9483d91ebefad341addee Jul 28 18:24:19.304413 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Name: tempest-AttachVolumeShelveTestJSON-64193895-project Jul 28 18:24:19.304413 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: method: > Jul 28 18:24:19.304413 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: exception: Instance 2b1c63c9-4f4b-4c9e-91da-42f88fd63286 could not be found. Jul 28 18:24:19.304413 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: action_args: {'id': '2b1c63c9-4f4b-4c9e-91da-42f88fd63286'} Jul 28 18:24:19.305555 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:24:19.305555 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:24:19.305555 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:24:19.305555 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:24:19.305555 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:24:19.305555 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:24:19.305555 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:24:19.305555 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:24:19.305555 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:24:19.305555 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:24:19.305555 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b1c63c9-4f4b-4c9e-91da-42f88fd63286 could not be found. Jul 28 18:24:19.305555 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:24:19.305555 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:24:19.305555 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:24:19.305555 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:24:19.305555 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:24:19.305555 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:24:19.305555 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:24:19.305555 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:24:19.305555 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:24:19.307810 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:24:19.307810 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 18:24:19.307810 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 18:24:19.307810 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 18:24:19.307810 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 18:24:19.307810 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:24:19.307810 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:24:19.307810 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:24:19.307810 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:24:19.307810 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b1c63c9-4f4b-4c9e-91da-42f88fd63286 could not be found. Jul 28 18:24:19.307810 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:24:19.307810 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:24:19.307810 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:24:19.307810 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:24:19.307810 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:24:19.307810 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:24:19.307810 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:24:19.307810 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:24:19.307810 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b1c63c9-4f4b-4c9e-91da-42f88fd63286 could not be found. Jul 28 18:24:19.307810 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:24:19.309431 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-66197fc1-8f1f-41e4-b80d-c3fd088c8d20 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Returning 404 to user: Instance 2b1c63c9-4f4b-4c9e-91da-42f88fd63286 could not be found. {{(pid=118453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:24:19.309431 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-66197fc1-8f1f-41e4-b80d-c3fd088c8d20 tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "DELETE /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 404 len: 111 microversion: 2.20 time: 0.047396 Jul 28 18:24:19.309431 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 514/1039] 10.222.0.86 () {60 vars in 1280 bytes} [Thu Jul 28 18:24:19 2022] DELETE /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 18:24:19.316740 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-e49cdfd8-7b89-464c-b492-e8b5c3e3ef4a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:19.317475 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-e49cdfd8-7b89-464c-b492-e8b5c3e3ef4a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] [instance: 2b1c63c9-4f4b-4c9e-91da-42f88fd63286] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:24:19.325312 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e49cdfd8-7b89-464c-b492-e8b5c3e3ef4a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:19.325534 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e49cdfd8-7b89-464c-b492-e8b5c3e3ef4a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:19.326265 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e49cdfd8-7b89-464c-b492-e8b5c3e3ef4a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:19.326705 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e49cdfd8-7b89-464c-b492-e8b5c3e3ef4a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:19.339999 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.wsgi [None req-e49cdfd8-7b89-464c-b492-e8b5c3e3ef4a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] HTTP exception thrown: Instance 2b1c63c9-4f4b-4c9e-91da-42f88fd63286 could not be found. Jul 28 18:24:19.341667 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-e49cdfd8-7b89-464c-b492-e8b5c3e3ef4a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Request method failure captured: Jul 28 18:24:19.341667 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: request: GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 HTTP/1.1 Jul 28 18:24:19.341667 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Accept: application/json Jul 28 18:24:19.341667 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Accept-Encoding: identity Jul 28 18:24:19.341667 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Connection: close Jul 28 18:24:19.341667 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Content-Length: 0 Jul 28 18:24:19.341667 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Content-Type: application/json Jul 28 18:24:19.341667 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Host: 10.222.0.86 Jul 28 18:24:19.341667 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Openstack-System-Scope: None Jul 28 18:24:19.341667 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: User-Agent: python-urllib3/1.26.10 Jul 28 18:24:19.341667 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Auth-Token: gAAAAABi4tGYtri9w88fvm9LdwZ9q5eT8OemXnJrGThiFt_Jy7tnSkbCyYLecvfGGXcIDWtA5RcE8mn3rAtlD95iEejdxlDLjKdZ6FTdXo73WOMqFIz_TEcxTWtQAJ9fBowbsqs0rahQu51tqhBl7gHiC-szGsusyvQggLBcC5r-9AfeERA-cPc Jul 28 18:24:19.341667 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Domain-Id: None Jul 28 18:24:19.341667 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Domain-Name: None Jul 28 18:24:19.341667 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Identity-Status: Confirmed Jul 28 18:24:19.341667 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Is-Admin-Project: True Jul 28 18:24:19.341667 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 18:24:19.341667 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Domain-Id: default Jul 28 18:24:19.341667 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Domain-Name: Default Jul 28 18:24:19.341667 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Id: 9e962e97777048b79415ba13adcc95be Jul 28 18:24:19.341667 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-64193895 Jul 28 18:24:19.341667 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Role: member,reader Jul 28 18:24:19.341667 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Roles: member,reader Jul 28 18:24:19.343442 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_9e962e97777048b79415ba13adcc95be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/9e962e97777048b79415ba13adcc95be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/9e962e97777048b79415ba13adcc95be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/9e962e97777048b79415ba13adcc95be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}] Jul 28 18:24:19.343442 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant: tempest-AttachVolumeShelveTestJSON-64193895 Jul 28 18:24:19.343442 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant-Id: 9e962e97777048b79415ba13adcc95be Jul 28 18:24:19.343442 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-64193895 Jul 28 18:24:19.343442 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User: tempest-AttachVolumeShelveTestJSON-64193895-project Jul 28 18:24:19.343442 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Domain-Id: default Jul 28 18:24:19.343442 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Domain-Name: Default Jul 28 18:24:19.343442 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Id: ca7d773290a9483d91ebefad341addee Jul 28 18:24:19.343442 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Name: tempest-AttachVolumeShelveTestJSON-64193895-project Jul 28 18:24:19.343442 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: method: > Jul 28 18:24:19.343442 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: exception: Instance 2b1c63c9-4f4b-4c9e-91da-42f88fd63286 could not be found. Jul 28 18:24:19.343442 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: action_args: {'id': '2b1c63c9-4f4b-4c9e-91da-42f88fd63286'} Jul 28 18:24:19.344355 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:24:19.344355 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:24:19.344355 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:24:19.344355 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:24:19.344355 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:24:19.344355 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:24:19.344355 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:24:19.344355 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:24:19.344355 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:24:19.344355 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:24:19.344355 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b1c63c9-4f4b-4c9e-91da-42f88fd63286 could not be found. Jul 28 18:24:19.344355 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:24:19.344355 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:24:19.344355 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:24:19.344355 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:24:19.344355 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:24:19.344355 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:24:19.344355 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:24:19.344355 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:24:19.344355 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:24:19.345902 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:24:19.345902 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 18:24:19.345902 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 18:24:19.345902 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:24:19.345902 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:24:19.345902 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:24:19.345902 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:24:19.345902 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b1c63c9-4f4b-4c9e-91da-42f88fd63286 could not be found. Jul 28 18:24:19.345902 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:24:19.345902 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:24:19.345902 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:24:19.345902 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:24:19.345902 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:24:19.345902 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:24:19.345902 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:24:19.345902 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:24:19.345902 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b1c63c9-4f4b-4c9e-91da-42f88fd63286 could not be found. Jul 28 18:24:19.345902 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:24:19.347345 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-e49cdfd8-7b89-464c-b492-e8b5c3e3ef4a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] Returning 404 to user: Instance 2b1c63c9-4f4b-4c9e-91da-42f88fd63286 could not be found. {{(pid=118454) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:24:19.347345 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-e49cdfd8-7b89-464c-b492-e8b5c3e3ef4a tempest-AttachVolumeShelveTestJSON-64193895 tempest-AttachVolumeShelveTestJSON-64193895-project] 10.222.0.86 "GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286" status: 404 len: 111 microversion: 2.20 time: 0.030704 Jul 28 18:24:19.347345 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 526/1040] 10.222.0.86 () {60 vars in 1277 bytes} [Thu Jul 28 18:24:19 2022] GET /compute/v2.1/servers/2b1c63c9-4f4b-4c9e-91da-42f88fd63286 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 18:24:19.650531 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f5693ce7-d38b-4117-99d5-b21243a213f1 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:19.657227 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f5693ce7-d38b-4117-99d5-b21243a213f1 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: b7714792-fa29-4af9-b28a-431c9bb2f5b2] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:24:19.658265 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f5693ce7-d38b-4117-99d5-b21243a213f1 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:19.658725 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f5693ce7-d38b-4117-99d5-b21243a213f1 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:19.659505 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f5693ce7-d38b-4117-99d5-b21243a213f1 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:19.659952 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f5693ce7-d38b-4117-99d5-b21243a213f1 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:19.872528 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f5693ce7-d38b-4117-99d5-b21243a213f1 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:24:19.882065 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f5693ce7-d38b-4117-99d5-b21243a213f1 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/b7714792-fa29-4af9-b28a-431c9bb2f5b2" status: 200 len: 1265 microversion: 2.1 time: 0.235332 Jul 28 18:24:19.882717 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 515/1041] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:24:19 2022] GET /compute/v2.1/servers/b7714792-fa29-4af9-b28a-431c9bb2f5b2 => generated 1265 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:24:20.322121 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-27d1e9ac-a7de-40aa-b5fc-3b9d4f4271dd tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:20.322897 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-27d1e9ac-a7de-40aa-b5fc-3b9d4f4271dd tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] [instance: 85b39e0f-e599-49d0-9e3f-d9f74f0f4770] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:24:20.335881 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-27d1e9ac-a7de-40aa-b5fc-3b9d4f4271dd tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:20.336483 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-27d1e9ac-a7de-40aa-b5fc-3b9d4f4271dd tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:20.337467 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-27d1e9ac-a7de-40aa-b5fc-3b9d4f4271dd tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:20.338024 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-27d1e9ac-a7de-40aa-b5fc-3b9d4f4271dd tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:20.493061 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-27d1e9ac-a7de-40aa-b5fc-3b9d4f4271dd tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f30ea147cc194c2f84add802a6ff624f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa13cc57b22c438b842a59ff4e207f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:24:20.502599 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-27d1e9ac-a7de-40aa-b5fc-3b9d4f4271dd tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] 10.222.0.86 "GET /compute/v2.1/servers/85b39e0f-e599-49d0-9e3f-d9f74f0f4770" status: 200 len: 1314 microversion: 2.1 time: 0.185092 Jul 28 18:24:20.503180 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 527/1042] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:24:20 2022] GET /compute/v2.1/servers/85b39e0f-e599-49d0-9e3f-d9f74f0f4770 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:24:20.641399 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-7d0f0a1f-2e21-4d21-9430-d1b6b4fc19f2 req-18485ea3-73b1-4c3b-afe1-5ec5c61fc16c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85b39e0f-e599-49d0-9e3f-d9f74f0f4770", "tag": "3e791fd4-782c-4fe5-a464-93b7a33d77e9"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:24:20.657818 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-7d0f0a1f-2e21-4d21-9430-d1b6b4fc19f2 req-18485ea3-73b1-4c3b-afe1-5ec5c61fc16c service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:20.658916 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-7d0f0a1f-2e21-4d21-9430-d1b6b4fc19f2 req-18485ea3-73b1-4c3b-afe1-5ec5c61fc16c service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:20.671752 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-7d0f0a1f-2e21-4d21-9430-d1b6b4fc19f2 req-18485ea3-73b1-4c3b-afe1-5ec5c61fc16c service nova] Creating event network-changed:3e791fd4-782c-4fe5-a464-93b7a33d77e9 for instance 85b39e0f-e599-49d0-9e3f-d9f74f0f4770 on hv-cinder-84617 Jul 28 18:24:20.686816 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-7d0f0a1f-2e21-4d21-9430-d1b6b4fc19f2 req-18485ea3-73b1-4c3b-afe1-5ec5c61fc16c service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050331 Jul 28 18:24:20.688014 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 516/1043] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 18:24:20.904162 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-64d051fc-4b98-4631-aec2-feae6ec2c31c tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:20.905055 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-64d051fc-4b98-4631-aec2-feae6ec2c31c tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: b7714792-fa29-4af9-b28a-431c9bb2f5b2] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:24:20.911454 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-64d051fc-4b98-4631-aec2-feae6ec2c31c tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:20.912337 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-64d051fc-4b98-4631-aec2-feae6ec2c31c tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:20.913153 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-64d051fc-4b98-4631-aec2-feae6ec2c31c tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:20.913619 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-64d051fc-4b98-4631-aec2-feae6ec2c31c tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:21.217523 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-64d051fc-4b98-4631-aec2-feae6ec2c31c tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:24:21.225966 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-64d051fc-4b98-4631-aec2-feae6ec2c31c tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/b7714792-fa29-4af9-b28a-431c9bb2f5b2" status: 200 len: 1265 microversion: 2.1 time: 0.327193 Jul 28 18:24:21.232921 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 528/1044] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:24:20 2022] GET /compute/v2.1/servers/b7714792-fa29-4af9-b28a-431c9bb2f5b2 => generated 1265 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:24:21.524385 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-30e752d2-8be8-404d-9faa-482ca6f87726 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:21.525307 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-30e752d2-8be8-404d-9faa-482ca6f87726 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] [instance: 85b39e0f-e599-49d0-9e3f-d9f74f0f4770] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:24:21.533902 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-30e752d2-8be8-404d-9faa-482ca6f87726 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:21.534507 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-30e752d2-8be8-404d-9faa-482ca6f87726 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:21.535391 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-30e752d2-8be8-404d-9faa-482ca6f87726 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:21.536122 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-30e752d2-8be8-404d-9faa-482ca6f87726 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:21.886129 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-30e752d2-8be8-404d-9faa-482ca6f87726 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f30ea147cc194c2f84add802a6ff624f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa13cc57b22c438b842a59ff4e207f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:24:21.893617 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-30e752d2-8be8-404d-9faa-482ca6f87726 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] 10.222.0.86 "GET /compute/v2.1/servers/85b39e0f-e599-49d0-9e3f-d9f74f0f4770" status: 200 len: 1314 microversion: 2.1 time: 0.373656 Jul 28 18:24:21.894183 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 517/1045] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:24:21 2022] GET /compute/v2.1/servers/85b39e0f-e599-49d0-9e3f-d9f74f0f4770 => generated 1314 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:24:22.256129 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-7fc0da0c-b373-4577-be76-c1c09dc2b2e8 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:22.256129 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-7fc0da0c-b373-4577-be76-c1c09dc2b2e8 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: b7714792-fa29-4af9-b28a-431c9bb2f5b2] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:24:22.258851 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-7fc0da0c-b373-4577-be76-c1c09dc2b2e8 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:22.259184 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-7fc0da0c-b373-4577-be76-c1c09dc2b2e8 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:22.260039 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-7fc0da0c-b373-4577-be76-c1c09dc2b2e8 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:22.261063 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-7fc0da0c-b373-4577-be76-c1c09dc2b2e8 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:22.280004 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:24:22.470987 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-7fc0da0c-b373-4577-be76-c1c09dc2b2e8 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:24:22.478600 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-7fc0da0c-b373-4577-be76-c1c09dc2b2e8 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/b7714792-fa29-4af9-b28a-431c9bb2f5b2" status: 200 len: 1265 microversion: 2.1 time: 0.231396 Jul 28 18:24:22.479167 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 529/1046] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:24:22 2022] GET /compute/v2.1/servers/b7714792-fa29-4af9-b28a-431c9bb2f5b2 => generated 1265 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:24:22.915052 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-bc500743-d8c4-4ebc-8ce9-d7f5a55f5687 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:22.915833 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-bc500743-d8c4-4ebc-8ce9-d7f5a55f5687 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] [instance: 85b39e0f-e599-49d0-9e3f-d9f74f0f4770] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:24:22.922515 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bc500743-d8c4-4ebc-8ce9-d7f5a55f5687 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:22.922967 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bc500743-d8c4-4ebc-8ce9-d7f5a55f5687 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:22.923742 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bc500743-d8c4-4ebc-8ce9-d7f5a55f5687 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:22.924180 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bc500743-d8c4-4ebc-8ce9-d7f5a55f5687 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:23.100597 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-bc500743-d8c4-4ebc-8ce9-d7f5a55f5687 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f30ea147cc194c2f84add802a6ff624f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa13cc57b22c438b842a59ff4e207f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:24:23.108786 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-bc500743-d8c4-4ebc-8ce9-d7f5a55f5687 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] 10.222.0.86 "GET /compute/v2.1/servers/85b39e0f-e599-49d0-9e3f-d9f74f0f4770" status: 200 len: 1314 microversion: 2.1 time: 0.197513 Jul 28 18:24:23.109927 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 518/1047] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:24:22 2022] GET /compute/v2.1/servers/85b39e0f-e599-49d0-9e3f-d9f74f0f4770 => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:24:23.499720 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-1a569805-15a0-4895-9ef4-fa2de6cadd2c tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:23.500330 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-1a569805-15a0-4895-9ef4-fa2de6cadd2c tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: b7714792-fa29-4af9-b28a-431c9bb2f5b2] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:24:23.506713 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-1a569805-15a0-4895-9ef4-fa2de6cadd2c tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:23.507388 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-1a569805-15a0-4895-9ef4-fa2de6cadd2c tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:23.508422 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-1a569805-15a0-4895-9ef4-fa2de6cadd2c tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:23.508859 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-1a569805-15a0-4895-9ef4-fa2de6cadd2c tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:23.668759 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-1a569805-15a0-4895-9ef4-fa2de6cadd2c tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:24:23.678598 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-1a569805-15a0-4895-9ef4-fa2de6cadd2c tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/b7714792-fa29-4af9-b28a-431c9bb2f5b2" status: 200 len: 1265 microversion: 2.1 time: 0.182800 Jul 28 18:24:23.679731 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 530/1048] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:24:23 2022] GET /compute/v2.1/servers/b7714792-fa29-4af9-b28a-431c9bb2f5b2 => generated 1265 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:24:23.739338 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-27354444-258e-4c14-bfc5-255c8a1a0faa req-bd557c44-9752-441d-baa3-cc0e374d7677 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7714792-fa29-4af9-b28a-431c9bb2f5b2", "name": "network-vif-plugged", "status": "completed", "tag": "019e5716-7cc7-4c8a-b0a4-f7f4aab4034a"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:24:23.750099 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-27354444-258e-4c14-bfc5-255c8a1a0faa req-bd557c44-9752-441d-baa3-cc0e374d7677 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:23.751181 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-27354444-258e-4c14-bfc5-255c8a1a0faa req-bd557c44-9752-441d-baa3-cc0e374d7677 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:23.762979 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-27354444-258e-4c14-bfc5-255c8a1a0faa req-bd557c44-9752-441d-baa3-cc0e374d7677 service nova] Creating event network-vif-plugged:019e5716-7cc7-4c8a-b0a4-f7f4aab4034a for instance b7714792-fa29-4af9-b28a-431c9bb2f5b2 on hv-cinder-84617 Jul 28 18:24:23.767897 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-27354444-258e-4c14-bfc5-255c8a1a0faa req-bd557c44-9752-441d-baa3-cc0e374d7677 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032285 Jul 28 18:24:23.768518 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 519/1049] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:24:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:24:24.130868 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-f7f4ee27-733a-4c7e-baad-b0797dee35e1 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:24.131488 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-f7f4ee27-733a-4c7e-baad-b0797dee35e1 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] [instance: 85b39e0f-e599-49d0-9e3f-d9f74f0f4770] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:24:24.137976 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f7f4ee27-733a-4c7e-baad-b0797dee35e1 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:24.138435 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f7f4ee27-733a-4c7e-baad-b0797dee35e1 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:24.139204 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f7f4ee27-733a-4c7e-baad-b0797dee35e1 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:24.139650 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f7f4ee27-733a-4c7e-baad-b0797dee35e1 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:24.274277 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-f7f4ee27-733a-4c7e-baad-b0797dee35e1 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f30ea147cc194c2f84add802a6ff624f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa13cc57b22c438b842a59ff4e207f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:24:24.282734 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-f7f4ee27-733a-4c7e-baad-b0797dee35e1 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] 10.222.0.86 "GET /compute/v2.1/servers/85b39e0f-e599-49d0-9e3f-d9f74f0f4770" status: 200 len: 1314 microversion: 2.1 time: 0.155884 Jul 28 18:24:24.283537 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 531/1050] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:24:24 2022] GET /compute/v2.1/servers/85b39e0f-e599-49d0-9e3f-d9f74f0f4770 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:24:24.701407 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-c017a6bc-d920-40a6-aa93-e97f13a80a49 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:24.702112 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-c017a6bc-d920-40a6-aa93-e97f13a80a49 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: b7714792-fa29-4af9-b28a-431c9bb2f5b2] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:24:24.708269 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c017a6bc-d920-40a6-aa93-e97f13a80a49 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:24.710149 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c017a6bc-d920-40a6-aa93-e97f13a80a49 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:24.710149 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c017a6bc-d920-40a6-aa93-e97f13a80a49 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:24.710149 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c017a6bc-d920-40a6-aa93-e97f13a80a49 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:24.728059 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:24:24.846207 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-c017a6bc-d920-40a6-aa93-e97f13a80a49 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:24:24.855214 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-c017a6bc-d920-40a6-aa93-e97f13a80a49 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/b7714792-fa29-4af9-b28a-431c9bb2f5b2" status: 200 len: 1265 microversion: 2.1 time: 0.159162 Jul 28 18:24:24.855798 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 520/1051] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:24:24 2022] GET /compute/v2.1/servers/b7714792-fa29-4af9-b28a-431c9bb2f5b2 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:24:25.306587 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-83184ba0-394f-4df4-a840-333aedb1705b tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:25.310936 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-83184ba0-394f-4df4-a840-333aedb1705b tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] [instance: 85b39e0f-e599-49d0-9e3f-d9f74f0f4770] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:24:25.315168 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-83184ba0-394f-4df4-a840-333aedb1705b tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:25.315841 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-83184ba0-394f-4df4-a840-333aedb1705b tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:25.316820 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-83184ba0-394f-4df4-a840-333aedb1705b tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:25.317304 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-83184ba0-394f-4df4-a840-333aedb1705b tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:25.461558 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-83184ba0-394f-4df4-a840-333aedb1705b tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f30ea147cc194c2f84add802a6ff624f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa13cc57b22c438b842a59ff4e207f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:24:25.470629 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-83184ba0-394f-4df4-a840-333aedb1705b tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] 10.222.0.86 "GET /compute/v2.1/servers/85b39e0f-e599-49d0-9e3f-d9f74f0f4770" status: 200 len: 1314 microversion: 2.1 time: 0.167856 Jul 28 18:24:25.471557 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 532/1052] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:24:25 2022] GET /compute/v2.1/servers/85b39e0f-e599-49d0-9e3f-d9f74f0f4770 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:24:25.581004 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell0:SELECT=2 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:24:25.581847 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell0:SELECT=8 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:24:25.699953 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a4e43575-86cf-490f-a570-a41e222d4daf tempest-VolumesSnapshotsTestJSON-1697123657 tempest-VolumesSnapshotsTestJSON-1697123657-project] Action: 'create', calling method: .version_select at 0x7f6fe254d820>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1794371026"}} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:24:25.875792 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-45712145-c057-4ec6-82a0-cdfab95cfe7b tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:25.876402 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-45712145-c057-4ec6-82a0-cdfab95cfe7b tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: b7714792-fa29-4af9-b28a-431c9bb2f5b2] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:24:25.882361 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-45712145-c057-4ec6-82a0-cdfab95cfe7b tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:25.882815 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-45712145-c057-4ec6-82a0-cdfab95cfe7b tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:25.883574 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-45712145-c057-4ec6-82a0-cdfab95cfe7b tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:25.884011 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-45712145-c057-4ec6-82a0-cdfab95cfe7b tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:26.018657 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-45712145-c057-4ec6-82a0-cdfab95cfe7b tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:24:26.024837 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-45712145-c057-4ec6-82a0-cdfab95cfe7b tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/b7714792-fa29-4af9-b28a-431c9bb2f5b2" status: 200 len: 1265 microversion: 2.1 time: 0.153047 Jul 28 18:24:26.025462 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 533/1053] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:24:25 2022] GET /compute/v2.1/servers/b7714792-fa29-4af9-b28a-431c9bb2f5b2 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:24:26.313302 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-a4e43575-86cf-490f-a570-a41e222d4daf tempest-VolumesSnapshotsTestJSON-1697123657 tempest-VolumesSnapshotsTestJSON-1697123657-project] 10.222.0.86 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.737157 Jul 28 18:24:26.328836 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 521/1054] 10.222.0.86 () {60 vars in 1155 bytes} [Thu Jul 28 18:24:25 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 739 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 28 18:24:26.329021 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-4096b56a-858d-4a98-85ed-6e5ac335a5e7 tempest-VolumesSnapshotsTestJSON-1697123657 tempest-VolumesSnapshotsTestJSON-1697123657-project] Calling method '.version_select at 0x7f6fe2655b80>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:26.377739 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-4096b56a-858d-4a98-85ed-6e5ac335a5e7 tempest-VolumesSnapshotsTestJSON-1697123657 tempest-VolumesSnapshotsTestJSON-1697123657-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/d7f2131e-9159-47f3-945a-47465c3e3874" status: 200 len: 345 microversion: 2.1 time: 0.055407 Jul 28 18:24:26.378312 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 534/1055] 10.222.0.86 () {58 vars in 1245 bytes} [Thu Jul 28 18:24:26 2022] GET /compute/v2.1/os-volumes/d7f2131e-9159-47f3-945a-47465c3e3874 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:24:26.491762 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-41522c21-7e4c-4ab8-ae9b-4397b57b148c tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:26.492377 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-41522c21-7e4c-4ab8-ae9b-4397b57b148c tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] [instance: 85b39e0f-e599-49d0-9e3f-d9f74f0f4770] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:24:26.499922 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-41522c21-7e4c-4ab8-ae9b-4397b57b148c tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:26.500425 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-41522c21-7e4c-4ab8-ae9b-4397b57b148c tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:26.501240 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-41522c21-7e4c-4ab8-ae9b-4397b57b148c tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:26.501761 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-41522c21-7e4c-4ab8-ae9b-4397b57b148c tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:26.635119 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-41522c21-7e4c-4ab8-ae9b-4397b57b148c tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f30ea147cc194c2f84add802a6ff624f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa13cc57b22c438b842a59ff4e207f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:24:26.642628 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-41522c21-7e4c-4ab8-ae9b-4397b57b148c tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] 10.222.0.86 "GET /compute/v2.1/servers/85b39e0f-e599-49d0-9e3f-d9f74f0f4770" status: 200 len: 1314 microversion: 2.1 time: 0.154919 Jul 28 18:24:26.643182 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 522/1056] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:24:26 2022] GET /compute/v2.1/servers/85b39e0f-e599-49d0-9e3f-d9f74f0f4770 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:24:27.041443 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell0:SELECT=4 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:24:27.045364 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-dbaa7fcb-8ce3-458c-9fbd-35e0f50eeb45 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:27.045982 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-dbaa7fcb-8ce3-458c-9fbd-35e0f50eeb45 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: b7714792-fa29-4af9-b28a-431c9bb2f5b2] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:24:27.052834 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-dbaa7fcb-8ce3-458c-9fbd-35e0f50eeb45 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:27.053312 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-dbaa7fcb-8ce3-458c-9fbd-35e0f50eeb45 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:27.054075 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-dbaa7fcb-8ce3-458c-9fbd-35e0f50eeb45 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:27.054513 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-dbaa7fcb-8ce3-458c-9fbd-35e0f50eeb45 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:27.183066 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-dbaa7fcb-8ce3-458c-9fbd-35e0f50eeb45 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:24:27.190215 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-dbaa7fcb-8ce3-458c-9fbd-35e0f50eeb45 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/b7714792-fa29-4af9-b28a-431c9bb2f5b2" status: 200 len: 1265 microversion: 2.1 time: 0.149592 Jul 28 18:24:27.190795 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 535/1057] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:24:27 2022] GET /compute/v2.1/servers/b7714792-fa29-4af9-b28a-431c9bb2f5b2 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:24:27.391966 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-63db48ad-b885-4c19-ba0f-479619cfcb5b tempest-VolumesSnapshotsTestJSON-1697123657 tempest-VolumesSnapshotsTestJSON-1697123657-project] Calling method '.version_select at 0x7f6fe2901670>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:27.440600 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-63db48ad-b885-4c19-ba0f-479619cfcb5b tempest-VolumesSnapshotsTestJSON-1697123657 tempest-VolumesSnapshotsTestJSON-1697123657-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/d7f2131e-9159-47f3-945a-47465c3e3874" status: 200 len: 345 microversion: 2.1 time: 0.052819 Jul 28 18:24:27.441303 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 523/1058] 10.222.0.86 () {58 vars in 1245 bytes} [Thu Jul 28 18:24:27 2022] GET /compute/v2.1/os-volumes/d7f2131e-9159-47f3-945a-47465c3e3874 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:24:27.663928 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-0611db3e-bac4-480e-a3b1-345f7cebd22d tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:27.664453 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-0611db3e-bac4-480e-a3b1-345f7cebd22d tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] [instance: 85b39e0f-e599-49d0-9e3f-d9f74f0f4770] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:24:27.671896 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-0611db3e-bac4-480e-a3b1-345f7cebd22d tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:27.672353 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-0611db3e-bac4-480e-a3b1-345f7cebd22d tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:27.673160 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-0611db3e-bac4-480e-a3b1-345f7cebd22d tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:27.673602 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-0611db3e-bac4-480e-a3b1-345f7cebd22d tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:27.703221 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-25955cb4-1e2f-468d-af28-cc1e7f6f3b38 req-22cba0f4-362f-4ae4-ae13-18d559bc6632 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85b39e0f-e599-49d0-9e3f-d9f74f0f4770", "name": "network-vif-plugged", "status": "completed", "tag": "3e791fd4-782c-4fe5-a464-93b7a33d77e9"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:24:27.715516 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-25955cb4-1e2f-468d-af28-cc1e7f6f3b38 req-22cba0f4-362f-4ae4-ae13-18d559bc6632 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:27.715972 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-25955cb4-1e2f-468d-af28-cc1e7f6f3b38 req-22cba0f4-362f-4ae4-ae13-18d559bc6632 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:27.726844 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-25955cb4-1e2f-468d-af28-cc1e7f6f3b38 req-22cba0f4-362f-4ae4-ae13-18d559bc6632 service nova] Creating event network-vif-plugged:3e791fd4-782c-4fe5-a464-93b7a33d77e9 for instance 85b39e0f-e599-49d0-9e3f-d9f74f0f4770 on hv-cinder-84617 Jul 28 18:24:27.732354 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-25955cb4-1e2f-468d-af28-cc1e7f6f3b38 req-22cba0f4-362f-4ae4-ae13-18d559bc6632 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033618 Jul 28 18:24:27.733013 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 524/1059] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:24:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 18:24:27.819832 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-0611db3e-bac4-480e-a3b1-345f7cebd22d tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f30ea147cc194c2f84add802a6ff624f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa13cc57b22c438b842a59ff4e207f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:24:27.828201 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-0611db3e-bac4-480e-a3b1-345f7cebd22d tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] 10.222.0.86 "GET /compute/v2.1/servers/85b39e0f-e599-49d0-9e3f-d9f74f0f4770" status: 200 len: 1314 microversion: 2.1 time: 0.168284 Jul 28 18:24:27.828998 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 536/1060] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:24:27 2022] GET /compute/v2.1/servers/85b39e0f-e599-49d0-9e3f-d9f74f0f4770 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:24:28.213050 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5d36bacd-1f3d-467a-a1b1-582b21d19597 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:28.213796 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-5d36bacd-1f3d-467a-a1b1-582b21d19597 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: b7714792-fa29-4af9-b28a-431c9bb2f5b2] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:24:28.220124 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5d36bacd-1f3d-467a-a1b1-582b21d19597 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:28.220581 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5d36bacd-1f3d-467a-a1b1-582b21d19597 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:28.221417 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5d36bacd-1f3d-467a-a1b1-582b21d19597 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:28.221864 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5d36bacd-1f3d-467a-a1b1-582b21d19597 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:28.357189 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-5d36bacd-1f3d-467a-a1b1-582b21d19597 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:24:28.364916 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-5d36bacd-1f3d-467a-a1b1-582b21d19597 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/b7714792-fa29-4af9-b28a-431c9bb2f5b2" status: 200 len: 1452 microversion: 2.1 time: 0.156774 Jul 28 18:24:28.365569 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 525/1061] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:24:28 2022] GET /compute/v2.1/servers/b7714792-fa29-4af9-b28a-431c9bb2f5b2 => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:24:28.385479 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-43ee4ca3-fa91-4234-a050-864118a68b0b tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:28.386099 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-43ee4ca3-fa91-4234-a050-864118a68b0b tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: b7714792-fa29-4af9-b28a-431c9bb2f5b2] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:24:28.392831 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-43ee4ca3-fa91-4234-a050-864118a68b0b tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:28.393318 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-43ee4ca3-fa91-4234-a050-864118a68b0b tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:28.394082 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-43ee4ca3-fa91-4234-a050-864118a68b0b tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:28.394520 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-43ee4ca3-fa91-4234-a050-864118a68b0b tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:28.456273 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-7b8ed09b-ac4d-46b2-8e36-2d5556d49b41 tempest-VolumesSnapshotsTestJSON-1697123657 tempest-VolumesSnapshotsTestJSON-1697123657-project] Calling method '.version_select at 0x7f6fe254d700>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:28.514620 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-7b8ed09b-ac4d-46b2-8e36-2d5556d49b41 tempest-VolumesSnapshotsTestJSON-1697123657 tempest-VolumesSnapshotsTestJSON-1697123657-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/d7f2131e-9159-47f3-945a-47465c3e3874" status: 200 len: 346 microversion: 2.1 time: 0.062666 Jul 28 18:24:28.515197 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 526/1062] 10.222.0.86 () {58 vars in 1245 bytes} [Thu Jul 28 18:24:28 2022] GET /compute/v2.1/os-volumes/d7f2131e-9159-47f3-945a-47465c3e3874 => generated 346 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:24:28.527506 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-eec562cd-c5f1-48bf-9cbf-aaae04183a3e tempest-VolumesSnapshotsTestJSON-1697123657 tempest-VolumesSnapshotsTestJSON-1697123657-project] Action: 'create', calling method: .version_select at 0x7f6fe6d89280>, body: {"snapshot": {"volume_id": "d7f2131e-9159-47f3-945a-47465c3e3874", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1436401607"}} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:24:28.588568 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-43ee4ca3-fa91-4234-a050-864118a68b0b tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:24:28.596144 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-43ee4ca3-fa91-4234-a050-864118a68b0b tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/b7714792-fa29-4af9-b28a-431c9bb2f5b2" status: 200 len: 1452 microversion: 2.1 time: 0.214532 Jul 28 18:24:28.597108 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 537/1063] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:24:28 2022] GET /compute/v2.1/servers/b7714792-fa29-4af9-b28a-431c9bb2f5b2 => generated 1452 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:24:28.850613 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-2de8450b-4548-481b-adcc-751a8e09ec61 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:28.851289 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-2de8450b-4548-481b-adcc-751a8e09ec61 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] [instance: 85b39e0f-e599-49d0-9e3f-d9f74f0f4770] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:24:28.858494 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2de8450b-4548-481b-adcc-751a8e09ec61 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:28.858944 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2de8450b-4548-481b-adcc-751a8e09ec61 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:28.859717 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2de8450b-4548-481b-adcc-751a8e09ec61 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:28.860155 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2de8450b-4548-481b-adcc-751a8e09ec61 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:29.054346 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-eec562cd-c5f1-48bf-9cbf-aaae04183a3e tempest-VolumesSnapshotsTestJSON-1697123657 tempest-VolumesSnapshotsTestJSON-1697123657-project] 10.222.0.86 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.530638 Jul 28 18:24:29.060802 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 527/1064] 10.222.0.86 () {60 vars in 1162 bytes} [Thu Jul 28 18:24:28 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 18:24:29.067232 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-2de8450b-4548-481b-adcc-751a8e09ec61 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f30ea147cc194c2f84add802a6ff624f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa13cc57b22c438b842a59ff4e207f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:24:29.072708 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d39d4a72-7494-4774-884b-05ba3649358f tempest-VolumesSnapshotsTestJSON-1697123657 tempest-VolumesSnapshotsTestJSON-1697123657-project] Calling method '.version_select at 0x7f6fe258db80>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:29.083539 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-2de8450b-4548-481b-adcc-751a8e09ec61 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] 10.222.0.86 "GET /compute/v2.1/servers/85b39e0f-e599-49d0-9e3f-d9f74f0f4770" status: 200 len: 1314 microversion: 2.1 time: 0.236990 Jul 28 18:24:29.084176 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 538/1065] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:24:28 2022] GET /compute/v2.1/servers/85b39e0f-e599-49d0-9e3f-d9f74f0f4770 => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:24:29.110093 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-d39d4a72-7494-4774-884b-05ba3649358f tempest-VolumesSnapshotsTestJSON-1697123657 tempest-VolumesSnapshotsTestJSON-1697123657-project] 10.222.0.86 "GET /compute/v2.1/os-snapshots/170702ab-8add-41e7-910d-636be4d5e2a4" status: 200 len: 287 microversion: 2.1 time: 0.047626 Jul 28 18:24:29.110662 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 528/1066] 10.222.0.86 () {58 vars in 1251 bytes} [Thu Jul 28 18:24:29 2022] GET /compute/v2.1/os-snapshots/170702ab-8add-41e7-910d-636be4d5e2a4 => generated 287 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:24:29.121418 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-936005a3-c0ec-4a10-b9cc-29f8c0c6ea6c tempest-VolumesSnapshotsTestJSON-1697123657 tempest-VolumesSnapshotsTestJSON-1697123657-project] Calling method '.version_select at 0x7f6fe2652e50>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:29.165721 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-936005a3-c0ec-4a10-b9cc-29f8c0c6ea6c tempest-VolumesSnapshotsTestJSON-1697123657 tempest-VolumesSnapshotsTestJSON-1697123657-project] 10.222.0.86 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.048083 Jul 28 18:24:29.166346 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 539/1067] 10.222.0.86 () {58 vars in 1140 bytes} [Thu Jul 28 18:24:29 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:24:29.177707 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-9c4af01c-cb65-4e58-9991-ce9db96cece6 tempest-VolumesSnapshotsTestJSON-1697123657 tempest-VolumesSnapshotsTestJSON-1697123657-project] Calling method '.version_select at 0x7f6fe6d89430>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:29.218413 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-9c4af01c-cb65-4e58-9991-ce9db96cece6 tempest-VolumesSnapshotsTestJSON-1697123657 tempest-VolumesSnapshotsTestJSON-1697123657-project] 10.222.0.86 "GET /compute/v2.1/os-snapshots/170702ab-8add-41e7-910d-636be4d5e2a4" status: 200 len: 287 microversion: 2.1 time: 0.044533 Jul 28 18:24:29.218993 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 529/1068] 10.222.0.86 () {58 vars in 1251 bytes} [Thu Jul 28 18:24:29 2022] GET /compute/v2.1/os-snapshots/170702ab-8add-41e7-910d-636be4d5e2a4 => generated 287 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:24:30.106338 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-de738948-a60c-48bb-8504-c95d33f88a8e tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:30.107014 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-de738948-a60c-48bb-8504-c95d33f88a8e tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] [instance: 85b39e0f-e599-49d0-9e3f-d9f74f0f4770] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:24:30.113188 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-de738948-a60c-48bb-8504-c95d33f88a8e tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:30.113641 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-de738948-a60c-48bb-8504-c95d33f88a8e tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:30.114410 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-de738948-a60c-48bb-8504-c95d33f88a8e tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:30.114878 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-de738948-a60c-48bb-8504-c95d33f88a8e tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:30.233821 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-28e8df57-c225-4609-bc10-11a0002434ca tempest-VolumesSnapshotsTestJSON-1697123657 tempest-VolumesSnapshotsTestJSON-1697123657-project] Calling method '.version_select at 0x7f6fe6d89280>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:30.290042 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-28e8df57-c225-4609-bc10-11a0002434ca tempest-VolumesSnapshotsTestJSON-1697123657 tempest-VolumesSnapshotsTestJSON-1697123657-project] 10.222.0.86 "GET /compute/v2.1/os-snapshots/170702ab-8add-41e7-910d-636be4d5e2a4" status: 200 len: 287 microversion: 2.1 time: 0.060636 Jul 28 18:24:30.291138 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 530/1069] 10.222.0.86 () {58 vars in 1251 bytes} [Thu Jul 28 18:24:30 2022] GET /compute/v2.1/os-snapshots/170702ab-8add-41e7-910d-636be4d5e2a4 => generated 287 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:24:30.389460 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-de738948-a60c-48bb-8504-c95d33f88a8e tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f30ea147cc194c2f84add802a6ff624f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa13cc57b22c438b842a59ff4e207f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:24:30.397898 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-de738948-a60c-48bb-8504-c95d33f88a8e tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] 10.222.0.86 "GET /compute/v2.1/servers/85b39e0f-e599-49d0-9e3f-d9f74f0f4770" status: 200 len: 1314 microversion: 2.1 time: 0.296502 Jul 28 18:24:30.398659 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 540/1070] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:24:30 2022] GET /compute/v2.1/servers/85b39e0f-e599-49d0-9e3f-d9f74f0f4770 => generated 1314 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:24:30.834434 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-9d594cc9-10a5-43c1-81b1-7671579f8f6d req-b3b8bbcb-3880-4483-9d19-dd9b67a9bcf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7714792-fa29-4af9-b28a-431c9bb2f5b2", "tag": "019e5716-7cc7-4c8a-b0a4-f7f4aab4034a"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:24:30.844851 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-9d594cc9-10a5-43c1-81b1-7671579f8f6d req-b3b8bbcb-3880-4483-9d19-dd9b67a9bcf7 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:30.845329 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-9d594cc9-10a5-43c1-81b1-7671579f8f6d req-b3b8bbcb-3880-4483-9d19-dd9b67a9bcf7 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:30.856420 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-9d594cc9-10a5-43c1-81b1-7671579f8f6d req-b3b8bbcb-3880-4483-9d19-dd9b67a9bcf7 service nova] Creating event network-changed:019e5716-7cc7-4c8a-b0a4-f7f4aab4034a for instance b7714792-fa29-4af9-b28a-431c9bb2f5b2 on hv-cinder-84617 Jul 28 18:24:30.861705 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-9d594cc9-10a5-43c1-81b1-7671579f8f6d req-b3b8bbcb-3880-4483-9d19-dd9b67a9bcf7 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031079 Jul 28 18:24:30.862315 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 531/1071] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:24:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:24:31.304369 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-3d8842ea-c044-44f1-997e-744824da5ed3 tempest-VolumesSnapshotsTestJSON-1697123657 tempest-VolumesSnapshotsTestJSON-1697123657-project] Calling method '.version_select at 0x7f6fe2652c10>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:31.334606 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-3d8842ea-c044-44f1-997e-744824da5ed3 tempest-VolumesSnapshotsTestJSON-1697123657 tempest-VolumesSnapshotsTestJSON-1697123657-project] 10.222.0.86 "GET /compute/v2.1/os-snapshots/170702ab-8add-41e7-910d-636be4d5e2a4" status: 200 len: 287 microversion: 2.1 time: 0.035036 Jul 28 18:24:31.335174 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 541/1072] 10.222.0.86 () {58 vars in 1251 bytes} [Thu Jul 28 18:24:31 2022] GET /compute/v2.1/os-snapshots/170702ab-8add-41e7-910d-636be4d5e2a4 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:24:31.425664 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-2a48b609-2100-49a2-a999-f93f4697672a tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:31.426709 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-2a48b609-2100-49a2-a999-f93f4697672a tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] [instance: 85b39e0f-e599-49d0-9e3f-d9f74f0f4770] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:24:31.432987 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2a48b609-2100-49a2-a999-f93f4697672a tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:31.433535 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2a48b609-2100-49a2-a999-f93f4697672a tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:31.434288 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2a48b609-2100-49a2-a999-f93f4697672a tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:31.435058 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2a48b609-2100-49a2-a999-f93f4697672a tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:31.567180 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-2a48b609-2100-49a2-a999-f93f4697672a tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f30ea147cc194c2f84add802a6ff624f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa13cc57b22c438b842a59ff4e207f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:24:31.575365 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-2a48b609-2100-49a2-a999-f93f4697672a tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] 10.222.0.86 "GET /compute/v2.1/servers/85b39e0f-e599-49d0-9e3f-d9f74f0f4770" status: 200 len: 1314 microversion: 2.1 time: 0.155395 Jul 28 18:24:31.575946 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 532/1073] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:24:31 2022] GET /compute/v2.1/servers/85b39e0f-e599-49d0-9e3f-d9f74f0f4770 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:24:32.348266 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-0497e911-d101-4e04-a96c-ed8756bc7536 tempest-VolumesSnapshotsTestJSON-1697123657 tempest-VolumesSnapshotsTestJSON-1697123657-project] Calling method '.version_select at 0x7f6fe2659310>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:32.378132 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-0497e911-d101-4e04-a96c-ed8756bc7536 tempest-VolumesSnapshotsTestJSON-1697123657 tempest-VolumesSnapshotsTestJSON-1697123657-project] 10.222.0.86 "GET /compute/v2.1/os-snapshots/170702ab-8add-41e7-910d-636be4d5e2a4" status: 200 len: 287 microversion: 2.1 time: 0.034288 Jul 28 18:24:32.378689 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 542/1074] 10.222.0.86 () {58 vars in 1251 bytes} [Thu Jul 28 18:24:32 2022] GET /compute/v2.1/os-snapshots/170702ab-8add-41e7-910d-636be4d5e2a4 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:24:32.596408 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-31c85671-7d06-4d78-acd5-4241587bc4b9 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:32.597031 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-31c85671-7d06-4d78-acd5-4241587bc4b9 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] [instance: 85b39e0f-e599-49d0-9e3f-d9f74f0f4770] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:24:32.603603 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-31c85671-7d06-4d78-acd5-4241587bc4b9 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:32.603998 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-31c85671-7d06-4d78-acd5-4241587bc4b9 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:32.604761 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-31c85671-7d06-4d78-acd5-4241587bc4b9 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:32.605745 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-31c85671-7d06-4d78-acd5-4241587bc4b9 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:32.734272 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-31c85671-7d06-4d78-acd5-4241587bc4b9 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f30ea147cc194c2f84add802a6ff624f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa13cc57b22c438b842a59ff4e207f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:24:32.741745 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-31c85671-7d06-4d78-acd5-4241587bc4b9 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] 10.222.0.86 "GET /compute/v2.1/servers/85b39e0f-e599-49d0-9e3f-d9f74f0f4770" status: 200 len: 1314 microversion: 2.1 time: 0.149328 Jul 28 18:24:32.742300 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 533/1075] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:24:32 2022] GET /compute/v2.1/servers/85b39e0f-e599-49d0-9e3f-d9f74f0f4770 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:24:33.391260 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-3cf94449-11cf-4911-b3fe-53708e4c8313 tempest-VolumesSnapshotsTestJSON-1697123657 tempest-VolumesSnapshotsTestJSON-1697123657-project] Calling method '.version_select at 0x7f6fe2655c10>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:33.422242 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-3cf94449-11cf-4911-b3fe-53708e4c8313 tempest-VolumesSnapshotsTestJSON-1697123657 tempest-VolumesSnapshotsTestJSON-1697123657-project] 10.222.0.86 "GET /compute/v2.1/os-snapshots/170702ab-8add-41e7-910d-636be4d5e2a4" status: 200 len: 287 microversion: 2.1 time: 0.035411 Jul 28 18:24:33.422810 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 543/1076] 10.222.0.86 () {58 vars in 1251 bytes} [Thu Jul 28 18:24:33 2022] GET /compute/v2.1/os-snapshots/170702ab-8add-41e7-910d-636be4d5e2a4 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:24:33.764317 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-1a4a1e52-ff34-4492-8b14-ae6696ddbc14 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:33.764940 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-1a4a1e52-ff34-4492-8b14-ae6696ddbc14 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] [instance: 85b39e0f-e599-49d0-9e3f-d9f74f0f4770] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:24:33.771542 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1a4a1e52-ff34-4492-8b14-ae6696ddbc14 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:33.771998 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1a4a1e52-ff34-4492-8b14-ae6696ddbc14 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:33.772781 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1a4a1e52-ff34-4492-8b14-ae6696ddbc14 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:33.773370 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1a4a1e52-ff34-4492-8b14-ae6696ddbc14 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:34.240564 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-1a4a1e52-ff34-4492-8b14-ae6696ddbc14 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f30ea147cc194c2f84add802a6ff624f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa13cc57b22c438b842a59ff4e207f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:24:34.248647 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-1a4a1e52-ff34-4492-8b14-ae6696ddbc14 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] 10.222.0.86 "GET /compute/v2.1/servers/85b39e0f-e599-49d0-9e3f-d9f74f0f4770" status: 200 len: 1314 microversion: 2.1 time: 0.488777 Jul 28 18:24:34.249263 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 534/1077] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:24:33 2022] GET /compute/v2.1/servers/85b39e0f-e599-49d0-9e3f-d9f74f0f4770 => generated 1314 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:24:34.435726 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-ecad7f26-f165-4a54-8ee7-fa82b01784ea tempest-VolumesSnapshotsTestJSON-1697123657 tempest-VolumesSnapshotsTestJSON-1697123657-project] Calling method '.version_select at 0x7f6fe26e8550>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:34.464779 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-ecad7f26-f165-4a54-8ee7-fa82b01784ea tempest-VolumesSnapshotsTestJSON-1697123657 tempest-VolumesSnapshotsTestJSON-1697123657-project] 10.222.0.86 "GET /compute/v2.1/os-snapshots/170702ab-8add-41e7-910d-636be4d5e2a4" status: 200 len: 288 microversion: 2.1 time: 0.033908 Jul 28 18:24:34.465378 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 544/1078] 10.222.0.86 () {58 vars in 1251 bytes} [Thu Jul 28 18:24:34 2022] GET /compute/v2.1/os-snapshots/170702ab-8add-41e7-910d-636be4d5e2a4 => generated 288 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:24:34.476290 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-515c31bd-c780-4cbf-a9a9-4ae72f032705 tempest-VolumesSnapshotsTestJSON-1697123657 tempest-VolumesSnapshotsTestJSON-1697123657-project] Calling method '.version_select at 0x7f6fe6c523a0>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:34.618186 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-515c31bd-c780-4cbf-a9a9-4ae72f032705 tempest-VolumesSnapshotsTestJSON-1697123657 tempest-VolumesSnapshotsTestJSON-1697123657-project] 10.222.0.86 "DELETE /compute/v2.1/os-snapshots/170702ab-8add-41e7-910d-636be4d5e2a4" status: 202 len: 0 microversion: 2.1 time: 0.145685 Jul 28 18:24:34.618751 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 535/1079] 10.222.0.86 () {58 vars in 1254 bytes} [Thu Jul 28 18:24:34 2022] DELETE /compute/v2.1/os-snapshots/170702ab-8add-41e7-910d-636be4d5e2a4 => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 18:24:34.627268 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-797bc115-f8a3-468d-b9da-549449a6ed85 tempest-VolumesSnapshotsTestJSON-1697123657 tempest-VolumesSnapshotsTestJSON-1697123657-project] Calling method '.version_select at 0x7f6fe2652160>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:34.656200 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-797bc115-f8a3-468d-b9da-549449a6ed85 tempest-VolumesSnapshotsTestJSON-1697123657 tempest-VolumesSnapshotsTestJSON-1697123657-project] 10.222.0.86 "GET /compute/v2.1/os-snapshots/170702ab-8add-41e7-910d-636be4d5e2a4" status: 200 len: 287 microversion: 2.1 time: 0.032650 Jul 28 18:24:34.657026 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 545/1080] 10.222.0.86 () {58 vars in 1251 bytes} [Thu Jul 28 18:24:34 2022] GET /compute/v2.1/os-snapshots/170702ab-8add-41e7-910d-636be4d5e2a4 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:24:35.270481 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-33f367a7-7cee-4d05-afdd-aea2f8f55cf8 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:35.271093 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-33f367a7-7cee-4d05-afdd-aea2f8f55cf8 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] [instance: 85b39e0f-e599-49d0-9e3f-d9f74f0f4770] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:24:35.277955 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-33f367a7-7cee-4d05-afdd-aea2f8f55cf8 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:35.278404 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-33f367a7-7cee-4d05-afdd-aea2f8f55cf8 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:35.279227 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-33f367a7-7cee-4d05-afdd-aea2f8f55cf8 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:35.279667 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-33f367a7-7cee-4d05-afdd-aea2f8f55cf8 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:35.409430 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-33f367a7-7cee-4d05-afdd-aea2f8f55cf8 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f30ea147cc194c2f84add802a6ff624f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa13cc57b22c438b842a59ff4e207f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:24:35.417052 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-33f367a7-7cee-4d05-afdd-aea2f8f55cf8 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] 10.222.0.86 "GET /compute/v2.1/servers/85b39e0f-e599-49d0-9e3f-d9f74f0f4770" status: 200 len: 1462 microversion: 2.1 time: 0.151011 Jul 28 18:24:35.417634 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 536/1081] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:24:35 2022] GET /compute/v2.1/servers/85b39e0f-e599-49d0-9e3f-d9f74f0f4770 => generated 1462 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:24:35.467979 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-584a2eff-fd24-4e24-92bd-97b831e221c4 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:35.468452 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-584a2eff-fd24-4e24-92bd-97b831e221c4 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] [instance: 85b39e0f-e599-49d0-9e3f-d9f74f0f4770] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:24:35.470384 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:24:35.475703 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-584a2eff-fd24-4e24-92bd-97b831e221c4 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:35.476154 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-584a2eff-fd24-4e24-92bd-97b831e221c4 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:35.476916 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-584a2eff-fd24-4e24-92bd-97b831e221c4 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:35.477380 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-584a2eff-fd24-4e24-92bd-97b831e221c4 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:35.501530 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-584a2eff-fd24-4e24-92bd-97b831e221c4 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] [instance: 85b39e0f-e599-49d0-9e3f-d9f74f0f4770] Going to try to terminate instance {{(pid=118454) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 18:24:35.668719 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-4b72c3eb-c037-420f-9261-9204bfcac5cf tempest-VolumesSnapshotsTestJSON-1697123657 tempest-VolumesSnapshotsTestJSON-1697123657-project] Calling method '.version_select at 0x7f6fe6d890d0>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:35.693277 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.wsgi [None req-4b72c3eb-c037-420f-9261-9204bfcac5cf tempest-VolumesSnapshotsTestJSON-1697123657 tempest-VolumesSnapshotsTestJSON-1697123657-project] HTTP exception thrown: Snapshot 170702ab-8add-41e7-910d-636be4d5e2a4 could not be found. Jul 28 18:24:35.696601 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-4b72c3eb-c037-420f-9261-9204bfcac5cf tempest-VolumesSnapshotsTestJSON-1697123657 tempest-VolumesSnapshotsTestJSON-1697123657-project] Request method failure captured: Jul 28 18:24:35.696601 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: request: GET /compute/v2.1/os-snapshots/170702ab-8add-41e7-910d-636be4d5e2a4 HTTP/1.1 Jul 28 18:24:35.696601 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Accept: application/json Jul 28 18:24:35.696601 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Accept-Encoding: identity Jul 28 18:24:35.696601 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Connection: close Jul 28 18:24:35.696601 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Content-Length: 0 Jul 28 18:24:35.696601 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Content-Type: application/json Jul 28 18:24:35.696601 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Host: 10.222.0.86 Jul 28 18:24:35.696601 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Openstack-System-Scope: None Jul 28 18:24:35.696601 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: User-Agent: python-urllib3/1.26.10 Jul 28 18:24:35.696601 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Auth-Token: gAAAAABi4tRZX6Ka7yj2wOhciH21UYR-u07rb7rk66EpYPiChJo2Kd6VX3Hs9iMm2DYXIYd6CInpU7BySSlnkFsOgWNkhHS5glze3aAZU18pcYe4GwBNuOPYSrcuwVD4eJrRTgHpDe4WgOeDrYs19DwZzxm_7GEYjQr2LsZdtvNhLNB-uUBxSQ8 Jul 28 18:24:35.696601 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Domain-Id: None Jul 28 18:24:35.696601 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Domain-Name: None Jul 28 18:24:35.696601 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Identity-Status: Confirmed Jul 28 18:24:35.696601 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Is-Admin-Project: True Jul 28 18:24:35.696601 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Id: default Jul 28 18:24:35.696601 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Name: Default Jul 28 18:24:35.696601 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Id: 126babac1b524cba976e42b12c0c978f Jul 28 18:24:35.696601 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1697123657 Jul 28 18:24:35.696601 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Role: member,reader Jul 28 18:24:35.696601 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Roles: member,reader Jul 28 18:24:35.698204 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_126babac1b524cba976e42b12c0c978f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/126babac1b524cba976e42b12c0c978f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/126babac1b524cba976e42b12c0c978f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/126babac1b524cba976e42b12c0c978f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}] Jul 28 18:24:35.698204 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1697123657 Jul 28 18:24:35.698204 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant-Id: 126babac1b524cba976e42b12c0c978f Jul 28 18:24:35.698204 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1697123657 Jul 28 18:24:35.698204 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User: tempest-VolumesSnapshotsTestJSON-1697123657-project Jul 28 18:24:35.698204 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Id: default Jul 28 18:24:35.698204 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Name: Default Jul 28 18:24:35.698204 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Id: 50ed64353b2a445c9ccff01ffe02f087 Jul 28 18:24:35.698204 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1697123657-project Jul 28 18:24:35.698204 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: method: Jul 28 18:24:35.698204 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: exception: Snapshot 170702ab-8add-41e7-910d-636be4d5e2a4 could not be found. Jul 28 18:24:35.698204 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: action_args: {'id': '170702ab-8add-41e7-910d-636be4d5e2a4'} Jul 28 18:24:35.698204 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:24:35.699139 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:24:35.699139 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 28 18:24:35.699139 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 28 18:24:35.699139 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 28 18:24:35.699139 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 28 18:24:35.699139 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 28 18:24:35.699139 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 28 18:24:35.699139 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 18:24:35.699139 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 18:24:35.699139 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 18:24:35.699139 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 18:24:35.699139 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 18:24:35.699139 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 18:24:35.699139 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 18:24:35.699139 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 18:24:35.699139 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 170702ab-8add-41e7-910d-636be4d5e2a4 could not be found. (HTTP 404) (Request-ID: req-5020a76e-3ba5-4677-8e27-ffeae9bda52f) Jul 28 18:24:35.699139 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:24:35.699139 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:24:35.700853 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:24:35.700853 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:24:35.700853 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 28 18:24:35.700853 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 28 18:24:35.700853 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 18:24:35.700853 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 18:24:35.700853 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 28 18:24:35.700853 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 28 18:24:35.700853 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 18:24:35.700853 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 18:24:35.700853 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 28 18:24:35.700853 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 28 18:24:35.700853 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 28 18:24:35.700853 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 28 18:24:35.700853 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 28 18:24:35.700853 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 28 18:24:35.700853 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 18:24:35.700853 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 18:24:35.700853 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 18:24:35.702077 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 18:24:35.702077 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 18:24:35.702077 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 18:24:35.702077 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 18:24:35.702077 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 18:24:35.702077 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 170702ab-8add-41e7-910d-636be4d5e2a4 could not be found. Jul 28 18:24:35.702077 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:24:35.702077 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:24:35.702077 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:24:35.702077 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:24:35.702077 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:24:35.702077 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:24:35.702077 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:24:35.702077 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:24:35.702077 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 18:24:35.702077 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 18:24:35.702077 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:24:35.702077 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:24:35.702077 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 28 18:24:35.702077 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:24:35.703306 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 170702ab-8add-41e7-910d-636be4d5e2a4 could not be found. Jul 28 18:24:35.703306 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:24:35.703306 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:24:35.703306 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:24:35.703306 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:24:35.703306 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:24:35.703306 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:24:35.703306 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:24:35.703306 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:24:35.703306 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 170702ab-8add-41e7-910d-636be4d5e2a4 could not be found. Jul 28 18:24:35.703306 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:24:35.703306 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-4b72c3eb-c037-420f-9261-9204bfcac5cf tempest-VolumesSnapshotsTestJSON-1697123657 tempest-VolumesSnapshotsTestJSON-1697123657-project] Returning 404 to user: Snapshot 170702ab-8add-41e7-910d-636be4d5e2a4 could not be found. {{(pid=118453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:24:35.703306 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-4b72c3eb-c037-420f-9261-9204bfcac5cf tempest-VolumesSnapshotsTestJSON-1697123657 tempest-VolumesSnapshotsTestJSON-1697123657-project] 10.222.0.86 "GET /compute/v2.1/os-snapshots/170702ab-8add-41e7-910d-636be4d5e2a4" status: 404 len: 111 microversion: 2.1 time: 0.033315 Jul 28 18:24:35.704152 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 537/1082] 10.222.0.86 () {58 vars in 1251 bytes} [Thu Jul 28 18:24:35 2022] GET /compute/v2.1/os-snapshots/170702ab-8add-41e7-910d-636be4d5e2a4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:24:35.707023 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-29b97225-ef4f-488e-b339-7941c54634f4 tempest-VolumesSnapshotsTestJSON-1697123657 tempest-VolumesSnapshotsTestJSON-1697123657-project] Calling method '.version_select at 0x7f6fe258df70>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:35.800818 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-584a2eff-fd24-4e24-92bd-97b831e221c4 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] 10.222.0.86 "DELETE /compute/v2.1/servers/85b39e0f-e599-49d0-9e3f-d9f74f0f4770" status: 204 len: 0 microversion: 2.1 time: 0.337771 Jul 28 18:24:35.801507 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 546/1083] 10.222.0.86 () {58 vars in 1239 bytes} [Thu Jul 28 18:24:35 2022] DELETE /compute/v2.1/servers/85b39e0f-e599-49d0-9e3f-d9f74f0f4770 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 18:24:35.810475 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-a6e22926-8f3b-4b3b-b153-7d6f54403255 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:35.811172 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-a6e22926-8f3b-4b3b-b153-7d6f54403255 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] [instance: 85b39e0f-e599-49d0-9e3f-d9f74f0f4770] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:24:35.817280 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a6e22926-8f3b-4b3b-b153-7d6f54403255 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:35.817772 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a6e22926-8f3b-4b3b-b153-7d6f54403255 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:35.818537 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a6e22926-8f3b-4b3b-b153-7d6f54403255 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:35.818976 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a6e22926-8f3b-4b3b-b153-7d6f54403255 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:35.914904 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-29b97225-ef4f-488e-b339-7941c54634f4 tempest-VolumesSnapshotsTestJSON-1697123657 tempest-VolumesSnapshotsTestJSON-1697123657-project] 10.222.0.86 "DELETE /compute/v2.1/os-volumes/d7f2131e-9159-47f3-945a-47465c3e3874" status: 202 len: 0 microversion: 2.1 time: 0.211374 Jul 28 18:24:35.915651 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 538/1084] 10.222.0.86 () {58 vars in 1248 bytes} [Thu Jul 28 18:24:35 2022] DELETE /compute/v2.1/os-volumes/d7f2131e-9159-47f3-945a-47465c3e3874 => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 18:24:35.923803 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-9c12f852-77aa-40dd-973a-be391e09a7a4 tempest-VolumesSnapshotsTestJSON-1697123657 tempest-VolumesSnapshotsTestJSON-1697123657-project] Calling method '.version_select at 0x7f6fe26d3a60>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:35.956192 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-a6e22926-8f3b-4b3b-b153-7d6f54403255 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f30ea147cc194c2f84add802a6ff624f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa13cc57b22c438b842a59ff4e207f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:24:35.965354 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-a6e22926-8f3b-4b3b-b153-7d6f54403255 tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] 10.222.0.86 "GET /compute/v2.1/servers/85b39e0f-e599-49d0-9e3f-d9f74f0f4770" status: 200 len: 1468 microversion: 2.1 time: 0.158186 Jul 28 18:24:35.965354 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 547/1085] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:24:35 2022] GET /compute/v2.1/servers/85b39e0f-e599-49d0-9e3f-d9f74f0f4770 => generated 1468 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:24:35.974017 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-9c12f852-77aa-40dd-973a-be391e09a7a4 tempest-VolumesSnapshotsTestJSON-1697123657 tempest-VolumesSnapshotsTestJSON-1697123657-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/d7f2131e-9159-47f3-945a-47465c3e3874" status: 200 len: 345 microversion: 2.1 time: 0.054003 Jul 28 18:24:35.974645 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 539/1086] 10.222.0.86 () {58 vars in 1245 bytes} [Thu Jul 28 18:24:35 2022] GET /compute/v2.1/os-volumes/d7f2131e-9159-47f3-945a-47465c3e3874 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 18:24:36.985548 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-67b70cd7-340b-4829-aa6d-08e6c453579a tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:36.986219 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-67b70cd7-340b-4829-aa6d-08e6c453579a tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] [instance: 85b39e0f-e599-49d0-9e3f-d9f74f0f4770] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:24:36.989030 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d8c50663-8dd6-4f60-a2ed-2ebe989b8d94 tempest-VolumesSnapshotsTestJSON-1697123657 tempest-VolumesSnapshotsTestJSON-1697123657-project] Calling method '.version_select at 0x7f6fe6c2caf0>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:36.992751 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-67b70cd7-340b-4829-aa6d-08e6c453579a tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:36.993305 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-67b70cd7-340b-4829-aa6d-08e6c453579a tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:36.994017 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-67b70cd7-340b-4829-aa6d-08e6c453579a tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:36.994479 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-67b70cd7-340b-4829-aa6d-08e6c453579a tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:37.019500 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.wsgi [None req-d8c50663-8dd6-4f60-a2ed-2ebe989b8d94 tempest-VolumesSnapshotsTestJSON-1697123657 tempest-VolumesSnapshotsTestJSON-1697123657-project] HTTP exception thrown: Volume d7f2131e-9159-47f3-945a-47465c3e3874 could not be found. Jul 28 18:24:37.021803 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d8c50663-8dd6-4f60-a2ed-2ebe989b8d94 tempest-VolumesSnapshotsTestJSON-1697123657 tempest-VolumesSnapshotsTestJSON-1697123657-project] Request method failure captured: Jul 28 18:24:37.021803 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: request: GET /compute/v2.1/os-volumes/d7f2131e-9159-47f3-945a-47465c3e3874 HTTP/1.1 Jul 28 18:24:37.021803 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Accept: application/json Jul 28 18:24:37.021803 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Accept-Encoding: identity Jul 28 18:24:37.021803 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Connection: close Jul 28 18:24:37.021803 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Content-Length: 0 Jul 28 18:24:37.021803 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Content-Type: application/json Jul 28 18:24:37.021803 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Host: 10.222.0.86 Jul 28 18:24:37.021803 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Openstack-System-Scope: None Jul 28 18:24:37.021803 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: User-Agent: python-urllib3/1.26.10 Jul 28 18:24:37.021803 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Auth-Token: gAAAAABi4tRZX6Ka7yj2wOhciH21UYR-u07rb7rk66EpYPiChJo2Kd6VX3Hs9iMm2DYXIYd6CInpU7BySSlnkFsOgWNkhHS5glze3aAZU18pcYe4GwBNuOPYSrcuwVD4eJrRTgHpDe4WgOeDrYs19DwZzxm_7GEYjQr2LsZdtvNhLNB-uUBxSQ8 Jul 28 18:24:37.021803 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Domain-Id: None Jul 28 18:24:37.021803 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Domain-Name: None Jul 28 18:24:37.021803 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Identity-Status: Confirmed Jul 28 18:24:37.021803 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Is-Admin-Project: True Jul 28 18:24:37.021803 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Id: default Jul 28 18:24:37.021803 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Name: Default Jul 28 18:24:37.021803 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Id: 126babac1b524cba976e42b12c0c978f Jul 28 18:24:37.021803 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1697123657 Jul 28 18:24:37.021803 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Role: member,reader Jul 28 18:24:37.021803 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Roles: member,reader Jul 28 18:24:37.023457 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_126babac1b524cba976e42b12c0c978f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/126babac1b524cba976e42b12c0c978f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/126babac1b524cba976e42b12c0c978f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/126babac1b524cba976e42b12c0c978f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}] Jul 28 18:24:37.023457 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1697123657 Jul 28 18:24:37.023457 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant-Id: 126babac1b524cba976e42b12c0c978f Jul 28 18:24:37.023457 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1697123657 Jul 28 18:24:37.023457 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User: tempest-VolumesSnapshotsTestJSON-1697123657-project Jul 28 18:24:37.023457 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Id: default Jul 28 18:24:37.023457 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Name: Default Jul 28 18:24:37.023457 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Id: 50ed64353b2a445c9ccff01ffe02f087 Jul 28 18:24:37.023457 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1697123657-project Jul 28 18:24:37.023457 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: method: Jul 28 18:24:37.023457 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: exception: Volume d7f2131e-9159-47f3-945a-47465c3e3874 could not be found. Jul 28 18:24:37.023457 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: action_args: {'id': 'd7f2131e-9159-47f3-945a-47465c3e3874'} Jul 28 18:24:37.023457 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:24:37.033885 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:24:37.033885 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 18:24:37.033885 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 18:24:37.033885 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 18:24:37.033885 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 18:24:37.033885 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 18:24:37.033885 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 18:24:37.033885 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 18:24:37.033885 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 18:24:37.033885 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 18:24:37.033885 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 18:24:37.033885 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 18:24:37.033885 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 18:24:37.033885 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 18:24:37.033885 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 18:24:37.033885 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d7f2131e-9159-47f3-945a-47465c3e3874 could not be found. (HTTP 404) (Request-ID: req-6a367aab-8def-4a9c-8955-1a009ceeb30e) Jul 28 18:24:37.033885 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:24:37.033885 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:24:37.033885 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:24:37.035395 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:24:37.035395 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 28 18:24:37.035395 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 28 18:24:37.035395 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 18:24:37.035395 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 18:24:37.035395 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 18:24:37.035395 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 18:24:37.035395 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 18:24:37.035395 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 18:24:37.035395 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 18:24:37.035395 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 18:24:37.035395 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 18:24:37.035395 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 18:24:37.035395 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 18:24:37.035395 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 18:24:37.035395 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 18:24:37.035395 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 18:24:37.035395 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 18:24:37.035395 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 18:24:37.036826 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 18:24:37.036826 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 18:24:37.036826 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 18:24:37.036826 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 18:24:37.036826 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d7f2131e-9159-47f3-945a-47465c3e3874 could not be found. Jul 28 18:24:37.036826 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:24:37.036826 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:24:37.036826 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:24:37.036826 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:24:37.036826 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:24:37.036826 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:24:37.036826 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:24:37.036826 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:24:37.036826 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 18:24:37.036826 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 18:24:37.036826 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:24:37.036826 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:24:37.036826 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 28 18:24:37.036826 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:24:37.038425 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d7f2131e-9159-47f3-945a-47465c3e3874 could not be found. Jul 28 18:24:37.038425 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:24:37.038425 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:24:37.038425 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:24:37.038425 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:24:37.038425 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:24:37.038425 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:24:37.038425 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:24:37.038425 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:24:37.038425 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d7f2131e-9159-47f3-945a-47465c3e3874 could not be found. Jul 28 18:24:37.038425 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:24:37.038425 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d8c50663-8dd6-4f60-a2ed-2ebe989b8d94 tempest-VolumesSnapshotsTestJSON-1697123657 tempest-VolumesSnapshotsTestJSON-1697123657-project] Returning 404 to user: Volume d7f2131e-9159-47f3-945a-47465c3e3874 could not be found. {{(pid=118453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:24:37.038425 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-d8c50663-8dd6-4f60-a2ed-2ebe989b8d94 tempest-VolumesSnapshotsTestJSON-1697123657 tempest-VolumesSnapshotsTestJSON-1697123657-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/d7f2131e-9159-47f3-945a-47465c3e3874" status: 404 len: 109 microversion: 2.1 time: 0.039396 Jul 28 18:24:37.038425 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 540/1087] 10.222.0.86 () {58 vars in 1245 bytes} [Thu Jul 28 18:24:36 2022] GET /compute/v2.1/os-volumes/d7f2131e-9159-47f3-945a-47465c3e3874 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 18:24:37.048217 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-11d38575-2f4a-4b5f-867a-3af0d36fd672 tempest-VolumesSnapshotsTestJSON-1697123657 tempest-VolumesSnapshotsTestJSON-1697123657-project] Calling method '.version_select at 0x7f6fe6c81a60>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:37.082164 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.wsgi [None req-11d38575-2f4a-4b5f-867a-3af0d36fd672 tempest-VolumesSnapshotsTestJSON-1697123657 tempest-VolumesSnapshotsTestJSON-1697123657-project] HTTP exception thrown: Volume d7f2131e-9159-47f3-945a-47465c3e3874 could not be found. Jul 28 18:24:37.087447 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-11d38575-2f4a-4b5f-867a-3af0d36fd672 tempest-VolumesSnapshotsTestJSON-1697123657 tempest-VolumesSnapshotsTestJSON-1697123657-project] Request method failure captured: Jul 28 18:24:37.087447 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: request: DELETE /compute/v2.1/os-volumes/d7f2131e-9159-47f3-945a-47465c3e3874 HTTP/1.1 Jul 28 18:24:37.087447 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Accept: application/json Jul 28 18:24:37.087447 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Accept-Encoding: identity Jul 28 18:24:37.087447 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Connection: close Jul 28 18:24:37.087447 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Content-Length: 0 Jul 28 18:24:37.087447 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Content-Type: application/json Jul 28 18:24:37.087447 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Host: 10.222.0.86 Jul 28 18:24:37.087447 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Openstack-System-Scope: None Jul 28 18:24:37.087447 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: User-Agent: python-urllib3/1.26.10 Jul 28 18:24:37.087447 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Auth-Token: gAAAAABi4tRZX6Ka7yj2wOhciH21UYR-u07rb7rk66EpYPiChJo2Kd6VX3Hs9iMm2DYXIYd6CInpU7BySSlnkFsOgWNkhHS5glze3aAZU18pcYe4GwBNuOPYSrcuwVD4eJrRTgHpDe4WgOeDrYs19DwZzxm_7GEYjQr2LsZdtvNhLNB-uUBxSQ8 Jul 28 18:24:37.087447 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Domain-Id: None Jul 28 18:24:37.087447 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Domain-Name: None Jul 28 18:24:37.087447 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Identity-Status: Confirmed Jul 28 18:24:37.087447 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Is-Admin-Project: True Jul 28 18:24:37.087447 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Id: default Jul 28 18:24:37.087447 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Name: Default Jul 28 18:24:37.087447 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Id: 126babac1b524cba976e42b12c0c978f Jul 28 18:24:37.087447 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1697123657 Jul 28 18:24:37.087447 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Role: member,reader Jul 28 18:24:37.087447 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Roles: member,reader Jul 28 18:24:37.089309 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_126babac1b524cba976e42b12c0c978f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/126babac1b524cba976e42b12c0c978f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/126babac1b524cba976e42b12c0c978f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/126babac1b524cba976e42b12c0c978f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}] Jul 28 18:24:37.089309 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1697123657 Jul 28 18:24:37.089309 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant-Id: 126babac1b524cba976e42b12c0c978f Jul 28 18:24:37.089309 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1697123657 Jul 28 18:24:37.089309 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User: tempest-VolumesSnapshotsTestJSON-1697123657-project Jul 28 18:24:37.089309 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Id: default Jul 28 18:24:37.089309 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Name: Default Jul 28 18:24:37.089309 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Id: 50ed64353b2a445c9ccff01ffe02f087 Jul 28 18:24:37.089309 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1697123657-project Jul 28 18:24:37.089309 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: method: Jul 28 18:24:37.089309 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: exception: Volume d7f2131e-9159-47f3-945a-47465c3e3874 could not be found. Jul 28 18:24:37.089309 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: action_args: {'id': 'd7f2131e-9159-47f3-945a-47465c3e3874'} Jul 28 18:24:37.089309 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:24:37.090747 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:24:37.090747 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 18:24:37.090747 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 18:24:37.090747 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 18:24:37.090747 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 18:24:37.090747 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 18:24:37.090747 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 18:24:37.090747 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 18:24:37.090747 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 18:24:37.090747 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 18:24:37.090747 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 18:24:37.090747 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 18:24:37.090747 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 18:24:37.090747 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 18:24:37.090747 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 18:24:37.090747 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d7f2131e-9159-47f3-945a-47465c3e3874 could not be found. (HTTP 404) (Request-ID: req-25b6829a-d5c4-4ff5-8ca5-d94f9cef11a4) Jul 28 18:24:37.090747 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:24:37.090747 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:24:37.090747 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:24:37.092017 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:24:37.092017 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 28 18:24:37.092017 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 28 18:24:37.092017 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 18:24:37.092017 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 18:24:37.092017 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 18:24:37.092017 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 18:24:37.092017 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 18:24:37.092017 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 18:24:37.092017 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 18:24:37.092017 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 18:24:37.092017 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 18:24:37.092017 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 18:24:37.092017 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 18:24:37.092017 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 18:24:37.092017 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 18:24:37.092017 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 18:24:37.092017 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 18:24:37.092017 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 18:24:37.093284 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 18:24:37.093284 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 18:24:37.093284 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 18:24:37.093284 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 18:24:37.093284 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d7f2131e-9159-47f3-945a-47465c3e3874 could not be found. Jul 28 18:24:37.093284 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:24:37.093284 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:24:37.093284 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:24:37.093284 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:24:37.093284 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:24:37.093284 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:24:37.093284 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:24:37.093284 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:24:37.093284 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 18:24:37.093284 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 18:24:37.093284 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:24:37.093284 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:24:37.093284 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 28 18:24:37.093284 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:24:37.094484 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d7f2131e-9159-47f3-945a-47465c3e3874 could not be found. Jul 28 18:24:37.094484 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:24:37.094484 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:24:37.094484 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:24:37.094484 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:24:37.094484 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:24:37.094484 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:24:37.094484 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:24:37.094484 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:24:37.094484 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d7f2131e-9159-47f3-945a-47465c3e3874 could not be found. Jul 28 18:24:37.094484 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:24:37.094484 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-11d38575-2f4a-4b5f-867a-3af0d36fd672 tempest-VolumesSnapshotsTestJSON-1697123657 tempest-VolumesSnapshotsTestJSON-1697123657-project] Returning 404 to user: Volume d7f2131e-9159-47f3-945a-47465c3e3874 could not be found. {{(pid=118453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:24:37.094484 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-11d38575-2f4a-4b5f-867a-3af0d36fd672 tempest-VolumesSnapshotsTestJSON-1697123657 tempest-VolumesSnapshotsTestJSON-1697123657-project] 10.222.0.86 "DELETE /compute/v2.1/os-volumes/d7f2131e-9159-47f3-945a-47465c3e3874" status: 404 len: 109 microversion: 2.1 time: 0.042083 Jul 28 18:24:37.095401 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 541/1088] 10.222.0.86 () {58 vars in 1248 bytes} [Thu Jul 28 18:24:37 2022] DELETE /compute/v2.1/os-volumes/d7f2131e-9159-47f3-945a-47465c3e3874 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:24:37.101073 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3d008576-9b79-45a6-bee3-aa2d54046d09 tempest-VolumesSnapshotsTestJSON-1697123657 tempest-VolumesSnapshotsTestJSON-1697123657-project] Calling method '.version_select at 0x7f6fe25414c0>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:37.129218 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.wsgi [None req-3d008576-9b79-45a6-bee3-aa2d54046d09 tempest-VolumesSnapshotsTestJSON-1697123657 tempest-VolumesSnapshotsTestJSON-1697123657-project] HTTP exception thrown: Volume d7f2131e-9159-47f3-945a-47465c3e3874 could not be found. Jul 28 18:24:37.131202 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3d008576-9b79-45a6-bee3-aa2d54046d09 tempest-VolumesSnapshotsTestJSON-1697123657 tempest-VolumesSnapshotsTestJSON-1697123657-project] Request method failure captured: Jul 28 18:24:37.131202 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: request: GET /compute/v2.1/os-volumes/d7f2131e-9159-47f3-945a-47465c3e3874 HTTP/1.1 Jul 28 18:24:37.131202 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Accept: application/json Jul 28 18:24:37.131202 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Accept-Encoding: identity Jul 28 18:24:37.131202 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Connection: close Jul 28 18:24:37.131202 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Content-Length: 0 Jul 28 18:24:37.131202 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Content-Type: application/json Jul 28 18:24:37.131202 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Host: 10.222.0.86 Jul 28 18:24:37.131202 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Openstack-System-Scope: None Jul 28 18:24:37.131202 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: User-Agent: python-urllib3/1.26.10 Jul 28 18:24:37.131202 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Auth-Token: gAAAAABi4tRZX6Ka7yj2wOhciH21UYR-u07rb7rk66EpYPiChJo2Kd6VX3Hs9iMm2DYXIYd6CInpU7BySSlnkFsOgWNkhHS5glze3aAZU18pcYe4GwBNuOPYSrcuwVD4eJrRTgHpDe4WgOeDrYs19DwZzxm_7GEYjQr2LsZdtvNhLNB-uUBxSQ8 Jul 28 18:24:37.131202 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Domain-Id: None Jul 28 18:24:37.131202 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Domain-Name: None Jul 28 18:24:37.131202 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Identity-Status: Confirmed Jul 28 18:24:37.131202 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Is-Admin-Project: True Jul 28 18:24:37.131202 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Id: default Jul 28 18:24:37.131202 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Name: Default Jul 28 18:24:37.131202 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Id: 126babac1b524cba976e42b12c0c978f Jul 28 18:24:37.131202 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1697123657 Jul 28 18:24:37.131202 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Role: member,reader Jul 28 18:24:37.131202 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Roles: member,reader Jul 28 18:24:37.132691 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_126babac1b524cba976e42b12c0c978f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/126babac1b524cba976e42b12c0c978f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/126babac1b524cba976e42b12c0c978f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/126babac1b524cba976e42b12c0c978f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}] Jul 28 18:24:37.132691 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1697123657 Jul 28 18:24:37.132691 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant-Id: 126babac1b524cba976e42b12c0c978f Jul 28 18:24:37.132691 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1697123657 Jul 28 18:24:37.132691 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User: tempest-VolumesSnapshotsTestJSON-1697123657-project Jul 28 18:24:37.132691 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Id: default Jul 28 18:24:37.132691 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Name: Default Jul 28 18:24:37.132691 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Id: 50ed64353b2a445c9ccff01ffe02f087 Jul 28 18:24:37.132691 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1697123657-project Jul 28 18:24:37.132691 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: method: Jul 28 18:24:37.132691 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: exception: Volume d7f2131e-9159-47f3-945a-47465c3e3874 could not be found. Jul 28 18:24:37.132691 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: action_args: {'id': 'd7f2131e-9159-47f3-945a-47465c3e3874'} Jul 28 18:24:37.132691 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:24:37.133727 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:24:37.133727 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 18:24:37.133727 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 18:24:37.133727 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 18:24:37.133727 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 18:24:37.133727 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 18:24:37.133727 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 18:24:37.133727 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 18:24:37.133727 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 18:24:37.133727 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 18:24:37.133727 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 18:24:37.133727 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 18:24:37.133727 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 18:24:37.133727 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 18:24:37.133727 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 18:24:37.133727 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d7f2131e-9159-47f3-945a-47465c3e3874 could not be found. (HTTP 404) (Request-ID: req-4827b5da-8478-429d-9310-5baab5f4dad2) Jul 28 18:24:37.133727 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:24:37.133727 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:24:37.133727 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:24:37.135080 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:24:37.135080 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 28 18:24:37.135080 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 28 18:24:37.135080 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 18:24:37.135080 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 18:24:37.135080 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 18:24:37.135080 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 18:24:37.135080 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 18:24:37.135080 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 18:24:37.135080 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 18:24:37.135080 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 18:24:37.135080 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 18:24:37.135080 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 18:24:37.135080 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 18:24:37.135080 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 18:24:37.135080 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 18:24:37.135080 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 18:24:37.135080 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 18:24:37.135080 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 18:24:37.136455 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 18:24:37.136455 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 18:24:37.136455 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 18:24:37.136455 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 18:24:37.136455 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d7f2131e-9159-47f3-945a-47465c3e3874 could not be found. Jul 28 18:24:37.136455 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:24:37.136455 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:24:37.136455 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:24:37.136455 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:24:37.136455 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:24:37.136455 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:24:37.136455 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:24:37.136455 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:24:37.136455 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 18:24:37.136455 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 18:24:37.136455 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:24:37.136455 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:24:37.136455 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 28 18:24:37.136455 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:24:37.138753 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d7f2131e-9159-47f3-945a-47465c3e3874 could not be found. Jul 28 18:24:37.138753 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:24:37.138753 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:24:37.138753 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:24:37.138753 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:24:37.138753 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:24:37.138753 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:24:37.138753 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:24:37.138753 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:24:37.138753 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d7f2131e-9159-47f3-945a-47465c3e3874 could not be found. Jul 28 18:24:37.138753 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:24:37.138753 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3d008576-9b79-45a6-bee3-aa2d54046d09 tempest-VolumesSnapshotsTestJSON-1697123657 tempest-VolumesSnapshotsTestJSON-1697123657-project] Returning 404 to user: Volume d7f2131e-9159-47f3-945a-47465c3e3874 could not be found. {{(pid=118453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:24:37.138753 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-3d008576-9b79-45a6-bee3-aa2d54046d09 tempest-VolumesSnapshotsTestJSON-1697123657 tempest-VolumesSnapshotsTestJSON-1697123657-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/d7f2131e-9159-47f3-945a-47465c3e3874" status: 404 len: 109 microversion: 2.1 time: 0.036473 Jul 28 18:24:37.138753 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 542/1089] 10.222.0.86 () {58 vars in 1245 bytes} [Thu Jul 28 18:24:37 2022] GET /compute/v2.1/os-volumes/d7f2131e-9159-47f3-945a-47465c3e3874 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:24:37.169707 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-67b70cd7-340b-4829-aa6d-08e6c453579a tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f30ea147cc194c2f84add802a6ff624f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa13cc57b22c438b842a59ff4e207f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:24:37.177401 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-67b70cd7-340b-4829-aa6d-08e6c453579a tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] 10.222.0.86 "GET /compute/v2.1/servers/85b39e0f-e599-49d0-9e3f-d9f74f0f4770" status: 200 len: 1468 microversion: 2.1 time: 0.195808 Jul 28 18:24:37.178015 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 548/1090] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:24:36 2022] GET /compute/v2.1/servers/85b39e0f-e599-49d0-9e3f-d9f74f0f4770 => generated 1468 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:24:38.201645 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d6f21332-ea63-47f2-9cd1-dc45daaf42ca tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:38.208370 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-d6f21332-ea63-47f2-9cd1-dc45daaf42ca tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] [instance: 85b39e0f-e599-49d0-9e3f-d9f74f0f4770] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:24:38.215016 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:24:38.217836 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d6f21332-ea63-47f2-9cd1-dc45daaf42ca tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:38.217836 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d6f21332-ea63-47f2-9cd1-dc45daaf42ca tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:38.217836 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d6f21332-ea63-47f2-9cd1-dc45daaf42ca tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:38.218164 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d6f21332-ea63-47f2-9cd1-dc45daaf42ca tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:38.272477 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [req-991ac6da-42a4-47b4-9a9a-5cff42d3416e req-522ff8e1-2d36-4860-8d65-8dbf436d40cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85b39e0f-e599-49d0-9e3f-d9f74f0f4770", "name": "network-vif-deleted", "tag": "3e791fd4-782c-4fe5-a464-93b7a33d77e9"}]} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:24:38.291301 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-991ac6da-42a4-47b4-9a9a-5cff42d3416e req-522ff8e1-2d36-4860-8d65-8dbf436d40cc service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:38.294728 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-991ac6da-42a4-47b4-9a9a-5cff42d3416e req-522ff8e1-2d36-4860-8d65-8dbf436d40cc service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:38.306110 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.compute.server_external_events [req-991ac6da-42a4-47b4-9a9a-5cff42d3416e req-522ff8e1-2d36-4860-8d65-8dbf436d40cc service nova] Creating event network-vif-deleted:3e791fd4-782c-4fe5-a464-93b7a33d77e9 for instance 85b39e0f-e599-49d0-9e3f-d9f74f0f4770 on hv-cinder-84617 Jul 28 18:24:38.311754 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-d6f21332-ea63-47f2-9cd1-dc45daaf42ca tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f30ea147cc194c2f84add802a6ff624f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa13cc57b22c438b842a59ff4e207f10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:24:38.312520 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [req-991ac6da-42a4-47b4-9a9a-5cff42d3416e req-522ff8e1-2d36-4860-8d65-8dbf436d40cc service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045243 Jul 28 18:24:38.313701 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 549/1091] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:24:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:24:38.320263 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-d6f21332-ea63-47f2-9cd1-dc45daaf42ca tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] 10.222.0.86 "GET /compute/v2.1/servers/85b39e0f-e599-49d0-9e3f-d9f74f0f4770" status: 200 len: 1426 microversion: 2.1 time: 0.123501 Jul 28 18:24:38.320833 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 543/1092] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:24:38 2022] GET /compute/v2.1/servers/85b39e0f-e599-49d0-9e3f-d9f74f0f4770 => generated 1426 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:24:39.343831 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-8cc59db0-d09c-4bb0-80bb-b7c4ab1cb16c tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:24:39.344763 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-8cc59db0-d09c-4bb0-80bb-b7c4ab1cb16c tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] [instance: 85b39e0f-e599-49d0-9e3f-d9f74f0f4770] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:24:39.351622 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-8cc59db0-d09c-4bb0-80bb-b7c4ab1cb16c tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:39.352084 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-8cc59db0-d09c-4bb0-80bb-b7c4ab1cb16c tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:39.352862 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-8cc59db0-d09c-4bb0-80bb-b7c4ab1cb16c tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:24:39.353538 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-8cc59db0-d09c-4bb0-80bb-b7c4ab1cb16c tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:24:39.370369 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.wsgi [None req-8cc59db0-d09c-4bb0-80bb-b7c4ab1cb16c tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] HTTP exception thrown: Instance 85b39e0f-e599-49d0-9e3f-d9f74f0f4770 could not be found. Jul 28 18:24:39.372535 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-8cc59db0-d09c-4bb0-80bb-b7c4ab1cb16c tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Request method failure captured: Jul 28 18:24:39.372535 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: request: GET /compute/v2.1/servers/85b39e0f-e599-49d0-9e3f-d9f74f0f4770 HTTP/1.1 Jul 28 18:24:39.372535 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Accept: application/json Jul 28 18:24:39.372535 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Accept-Encoding: identity Jul 28 18:24:39.372535 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Connection: close Jul 28 18:24:39.372535 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Content-Length: 0 Jul 28 18:24:39.372535 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Content-Type: application/json Jul 28 18:24:39.372535 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Host: 10.222.0.86 Jul 28 18:24:39.372535 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Openstack-System-Scope: None Jul 28 18:24:39.372535 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: User-Agent: python-urllib3/1.26.10 Jul 28 18:24:39.372535 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Auth-Token: gAAAAABi4tRLdV1gV72IxdZGDVSEV8R-rfRjNLCHAyoZvhHSspXasyb0mz7ushsJRDycpaAJ08iYJhDwnVjGlqwsoWrHGzYzaqYSTHu7HykWcdipW23c-hn3RDfnKU6nu7joyUv-GcmdM6BDYyvnKY0AlRt46EjTfLcYwyXWYHEK_IbggK1f1v0 Jul 28 18:24:39.372535 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Domain-Id: None Jul 28 18:24:39.372535 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Domain-Name: None Jul 28 18:24:39.372535 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Identity-Status: Confirmed Jul 28 18:24:39.372535 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Is-Admin-Project: True Jul 28 18:24:39.372535 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Domain-Id: default Jul 28 18:24:39.372535 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Domain-Name: Default Jul 28 18:24:39.372535 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Id: fa13cc57b22c438b842a59ff4e207f10 Jul 28 18:24:39.372535 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Name: tempest-VolumesNegativeTest-1794823294 Jul 28 18:24:39.372535 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Role: member,reader Jul 28 18:24:39.372535 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Roles: member,reader Jul 28 18:24:39.374230 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_fa13cc57b22c438b842a59ff4e207f10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/fa13cc57b22c438b842a59ff4e207f10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/fa13cc57b22c438b842a59ff4e207f10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/fa13cc57b22c438b842a59ff4e207f10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}] Jul 28 18:24:39.374230 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant: tempest-VolumesNegativeTest-1794823294 Jul 28 18:24:39.374230 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant-Id: fa13cc57b22c438b842a59ff4e207f10 Jul 28 18:24:39.374230 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant-Name: tempest-VolumesNegativeTest-1794823294 Jul 28 18:24:39.374230 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User: tempest-VolumesNegativeTest-1794823294-project Jul 28 18:24:39.374230 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Domain-Id: default Jul 28 18:24:39.374230 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Domain-Name: Default Jul 28 18:24:39.374230 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Id: f30ea147cc194c2f84add802a6ff624f Jul 28 18:24:39.374230 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Name: tempest-VolumesNegativeTest-1794823294-project Jul 28 18:24:39.374230 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: method: > Jul 28 18:24:39.374230 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: exception: Instance 85b39e0f-e599-49d0-9e3f-d9f74f0f4770 could not be found. Jul 28 18:24:39.374230 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: action_args: {'id': '85b39e0f-e599-49d0-9e3f-d9f74f0f4770'} Jul 28 18:24:39.375184 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:24:39.375184 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:24:39.375184 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:24:39.375184 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:24:39.375184 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:24:39.375184 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:24:39.375184 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:24:39.375184 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:24:39.375184 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:24:39.375184 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:24:39.375184 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85b39e0f-e599-49d0-9e3f-d9f74f0f4770 could not be found. Jul 28 18:24:39.375184 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:24:39.375184 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:24:39.375184 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:24:39.375184 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:24:39.375184 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:24:39.375184 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:24:39.375184 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:24:39.375184 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:24:39.375184 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:24:39.376670 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:24:39.376670 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 18:24:39.376670 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 18:24:39.376670 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:24:39.376670 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:24:39.376670 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:24:39.376670 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:24:39.376670 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85b39e0f-e599-49d0-9e3f-d9f74f0f4770 could not be found. Jul 28 18:24:39.376670 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:24:39.376670 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:24:39.376670 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:24:39.376670 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:24:39.376670 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:24:39.376670 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:24:39.376670 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:24:39.376670 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:24:39.376670 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85b39e0f-e599-49d0-9e3f-d9f74f0f4770 could not be found. Jul 28 18:24:39.376670 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:24:39.384038 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-8cc59db0-d09c-4bb0-80bb-b7c4ab1cb16c tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] Returning 404 to user: Instance 85b39e0f-e599-49d0-9e3f-d9f74f0f4770 could not be found. {{(pid=118454) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:24:39.384038 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-8cc59db0-d09c-4bb0-80bb-b7c4ab1cb16c tempest-VolumesNegativeTest-1794823294 tempest-VolumesNegativeTest-1794823294-project] 10.222.0.86 "GET /compute/v2.1/servers/85b39e0f-e599-49d0-9e3f-d9f74f0f4770" status: 404 len: 111 microversion: 2.1 time: 0.035986 Jul 28 18:24:39.384038 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 550/1093] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:24:39 2022] GET /compute/v2.1/servers/85b39e0f-e599-49d0-9e3f-d9f74f0f4770 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:25:11.830504 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-4d659ab6-0614-4b91-b285-43587fabba4a tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Action: 'create', calling method: .version_select at 0x7f6fe25c8b80>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1882398696", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3EWqRo6EV0mMSSNChtjh8W0YzJheL0Wlb4kWsspuBHlia/znR4hODugrATif9GxHLIS2kKL6Grax9PSTuABKIi2gnRcSwaabTQb7EHcExj+Pc9nu80ZynmdEqhNyOc+A=="}} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:25:11.836905 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=48 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:25:11.848874 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.quota [None req-4d659ab6-0614-4b91-b285-43587fabba4a tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Getting quotas for project fe865ae79cfc41c1a2668f91e8cf0f70. Resources: {'key_pairs'} {{(pid=118453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 18:25:11.852906 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.quota [None req-4d659ab6-0614-4b91-b285-43587fabba4a tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Getting quotas for user 799a2726f3694d39a70cbdaed5257751 and project fe865ae79cfc41c1a2668f91e8cf0f70. Resources: {'key_pairs'} {{(pid=118453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 18:25:11.949210 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-4d659ab6-0614-4b91-b285-43587fabba4a tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] 10.222.0.86 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.122454 Jul 28 18:25:11.949807 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 544/1094] 10.222.0.86 () {60 vars in 1159 bytes} [Thu Jul 28 18:25:11 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:25:12.049101 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-cc4b8021-5f4c-4545-b031-932de07c69d9 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-495119214", "imageRef": "8a5dccdd-0937-4b68-aaba-53f2978be633", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1882398696", "networks": [{"uuid": "7fb6fae0-7909-4795-99cd-037590bcd627"}]}} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:25:12.057351 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:25:12.058087 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:25:12.103183 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.network.neutron [None req-cc4b8021-5f4c-4545-b031-932de07c69d9 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] validate_networks() for [('7fb6fae0-7909-4795-99cd-037590bcd627', None, None, None, None, None)] {{(pid=118454) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 18:25:12.473877 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.virt.hardware [None req-cc4b8021-5f4c-4545-b031-932de07c69d9 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Flavor limits 0:0:0 {{(pid=118454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 18:25:12.474306 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.virt.hardware [None req-cc4b8021-5f4c-4545-b031-932de07c69d9 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Image limits 0:0:0 {{(pid=118454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 18:25:12.474783 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.virt.hardware [None req-cc4b8021-5f4c-4545-b031-932de07c69d9 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Flavor pref 0:0:0 {{(pid=118454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 18:25:12.475195 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.virt.hardware [None req-cc4b8021-5f4c-4545-b031-932de07c69d9 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Image pref 0:0:0 {{(pid=118454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 18:25:12.475608 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.virt.hardware [None req-cc4b8021-5f4c-4545-b031-932de07c69d9 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 18:25:12.484529 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-cc4b8021-5f4c-4545-b031-932de07c69d9 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:12.485059 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-cc4b8021-5f4c-4545-b031-932de07c69d9 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:12.485885 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-cc4b8021-5f4c-4545-b031-932de07c69d9 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:12.486323 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-cc4b8021-5f4c-4545-b031-932de07c69d9 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:12.503309 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.quota [None req-cc4b8021-5f4c-4545-b031-932de07c69d9 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Getting quotas for project fe865ae79cfc41c1a2668f91e8cf0f70. Resources: {'cores', 'ram', 'instances'} {{(pid=118454) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 18:25:12.507218 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.quota [None req-cc4b8021-5f4c-4545-b031-932de07c69d9 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Getting quotas for user 799a2726f3694d39a70cbdaed5257751 and project fe865ae79cfc41c1a2668f91e8cf0f70. Resources: {'cores', 'ram', 'instances'} {{(pid=118454) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 18:25:12.519145 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-cc4b8021-5f4c-4545-b031-932de07c69d9 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Going to run 1 instances... {{(pid=118454) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 18:25:12.521376 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-cc4b8021-5f4c-4545-b031-932de07c69d9 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] [instance: 0308fa68-38a8-43e2-8e64-6de4f4a28f73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8a5dccdd-0937-4b68-aaba-53f2978be633',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118454) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 18:25:12.646350 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-cc4b8021-5f4c-4545-b031-932de07c69d9 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.601164 Jul 28 18:25:12.647090 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 551/1095] 10.222.0.86 () {60 vars in 1147 bytes} [Thu Jul 28 18:25:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 18:25:12.658219 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0970c91d-c940-4887-959a-2665126c4d36 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:12.658986 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0970c91d-c940-4887-959a-2665126c4d36 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] [instance: 0308fa68-38a8-43e2-8e64-6de4f4a28f73] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:12.722873 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-0970c91d-c940-4887-959a-2665126c4d36 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799a2726f3694d39a70cbdaed5257751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe865ae79cfc41c1a2668f91e8cf0f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:25:12.730071 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0970c91d-c940-4887-959a-2665126c4d36 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] 10.222.0.86 "GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73" status: 200 len: 1258 microversion: 2.1 time: 0.076168 Jul 28 18:25:12.736644 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 545/1096] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:25:12 2022] GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73 => generated 1258 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:25:13.751764 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-5796742e-be21-4312-91de-a6456e6ab39b tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:13.752308 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-5796742e-be21-4312-91de-a6456e6ab39b tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] [instance: 0308fa68-38a8-43e2-8e64-6de4f4a28f73] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:13.759009 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-5796742e-be21-4312-91de-a6456e6ab39b tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:13.768749 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-5796742e-be21-4312-91de-a6456e6ab39b tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:13.768749 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-5796742e-be21-4312-91de-a6456e6ab39b tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:13.768749 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-5796742e-be21-4312-91de-a6456e6ab39b tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:13.821240 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-5796742e-be21-4312-91de-a6456e6ab39b tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799a2726f3694d39a70cbdaed5257751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe865ae79cfc41c1a2668f91e8cf0f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:25:13.829098 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-5796742e-be21-4312-91de-a6456e6ab39b tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] 10.222.0.86 "GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73" status: 200 len: 1262 microversion: 2.1 time: 0.081989 Jul 28 18:25:13.829733 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 552/1097] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:25:13 2022] GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73 => generated 1262 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:25:14.851307 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-fb21d6d1-1ce4-4008-87ed-1ad325f1f9b9 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:14.852078 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-fb21d6d1-1ce4-4008-87ed-1ad325f1f9b9 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] [instance: 0308fa68-38a8-43e2-8e64-6de4f4a28f73] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:14.859584 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fb21d6d1-1ce4-4008-87ed-1ad325f1f9b9 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:14.860064 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fb21d6d1-1ce4-4008-87ed-1ad325f1f9b9 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:14.860817 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fb21d6d1-1ce4-4008-87ed-1ad325f1f9b9 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:14.861291 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fb21d6d1-1ce4-4008-87ed-1ad325f1f9b9 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:14.909694 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-ad7ec7f8-60a3-458e-955a-30a6838adaff tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:14.910293 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-ad7ec7f8-60a3-458e-955a-30a6838adaff tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: f7a41dc5-d258-475a-a1c1-9aad0723d5cb] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:14.916820 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ad7ec7f8-60a3-458e-955a-30a6838adaff tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:14.917337 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ad7ec7f8-60a3-458e-955a-30a6838adaff tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:14.918187 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ad7ec7f8-60a3-458e-955a-30a6838adaff tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:14.918626 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ad7ec7f8-60a3-458e-955a-30a6838adaff tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:14.930839 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-fb21d6d1-1ce4-4008-87ed-1ad325f1f9b9 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799a2726f3694d39a70cbdaed5257751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe865ae79cfc41c1a2668f91e8cf0f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:25:14.939951 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-fb21d6d1-1ce4-4008-87ed-1ad325f1f9b9 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] 10.222.0.86 "GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73" status: 200 len: 1310 microversion: 2.1 time: 0.092564 Jul 28 18:25:14.941000 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 546/1098] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:25:14 2022] GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73 => generated 1310 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:25:14.946076 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-ad7ec7f8-60a3-458e-955a-30a6838adaff tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb/ips" status: 200 len: 151 microversion: 2.1 time: 0.040480 Jul 28 18:25:14.946802 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 553/1099] 10.222.0.86 () {58 vars in 1248 bytes} [Thu Jul 28 18:25:14 2022] GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 18:25:14.958857 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-8fefca3e-db96-44b1-928c-e8f2830bb681 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "511b7979-40bd-4b69-986c-fc90e6810395"}} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:25:14.961741 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-8fefca3e-db96-44b1-928c-e8f2830bb681 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: f7a41dc5-d258-475a-a1c1-9aad0723d5cb] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:14.968203 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8fefca3e-db96-44b1-928c-e8f2830bb681 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:14.968704 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8fefca3e-db96-44b1-928c-e8f2830bb681 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:14.969950 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8fefca3e-db96-44b1-928c-e8f2830bb681 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:14.970627 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8fefca3e-db96-44b1-928c-e8f2830bb681 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:15.060679 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.wsgi [None req-8fefca3e-db96-44b1-928c-e8f2830bb681 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] HTTP exception thrown: Invalid volume: volume 511b7979-40bd-4b69-986c-fc90e6810395 is already attached to instances: 1b4d9d7f-8b12-4bfa-83a0-e55a8422d754 Jul 28 18:25:15.062643 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-8fefca3e-db96-44b1-928c-e8f2830bb681 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Request method failure captured: Jul 28 18:25:15.062643 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: request: POST /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb/os-volume_attachments HTTP/1.1 Jul 28 18:25:15.062643 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Accept: application/json Jul 28 18:25:15.062643 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Accept-Encoding: identity Jul 28 18:25:15.062643 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Connection: close Jul 28 18:25:15.062643 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Content-Length: 74 Jul 28 18:25:15.062643 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Content-Type: application/json Jul 28 18:25:15.062643 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Host: 10.222.0.86 Jul 28 18:25:15.062643 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Openstack-System-Scope: None Jul 28 18:25:15.062643 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: User-Agent: python-urllib3/1.26.10 Jul 28 18:25:15.062643 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Auth-Token: gAAAAABi4tOBTGRF9y9OAlefXy84t2lwOcq7Yp99X6H1ahc3ofs3Ehb5kBGF_9CYSBI80Rx8VFnnn80tQOz0U481VovOm_qAsLcyBFR5gizgfkClDfG1sybWskPJqHUNFOgadZvxg94hprAbcyZjmqgKLYfGkC4nDrgrf7oV07qvZWjTmYx3f6M Jul 28 18:25:15.062643 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Domain-Id: None Jul 28 18:25:15.062643 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Domain-Name: None Jul 28 18:25:15.062643 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Identity-Status: Confirmed Jul 28 18:25:15.062643 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Is-Admin-Project: True Jul 28 18:25:15.062643 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Id: default Jul 28 18:25:15.062643 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Name: Default Jul 28 18:25:15.062643 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Id: 104313ce72c94ea68c8cd3ee7f0cab2e Jul 28 18:25:15.062643 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Name: tempest-AttachVolumeNegativeTest-908754065 Jul 28 18:25:15.062643 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Role: member,reader Jul 28 18:25:15.062643 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Roles: member,reader Jul 28 18:25:15.064144 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_104313ce72c94ea68c8cd3ee7f0cab2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/104313ce72c94ea68c8cd3ee7f0cab2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/104313ce72c94ea68c8cd3ee7f0cab2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/104313ce72c94ea68c8cd3ee7f0cab2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}] Jul 28 18:25:15.064144 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant: tempest-AttachVolumeNegativeTest-908754065 Jul 28 18:25:15.064144 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant-Id: 104313ce72c94ea68c8cd3ee7f0cab2e Jul 28 18:25:15.064144 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-908754065 Jul 28 18:25:15.064144 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User: tempest-AttachVolumeNegativeTest-908754065-project Jul 28 18:25:15.064144 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Id: default Jul 28 18:25:15.064144 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Name: Default Jul 28 18:25:15.064144 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Id: e2b1f1c4bb2747e0845cdc2991e53b09 Jul 28 18:25:15.064144 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Name: tempest-AttachVolumeNegativeTest-908754065-project Jul 28 18:25:15.064144 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Jul 28 18:25:15.064144 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: {"volumeAttachment": {"volumeId": "511b7979-40bd-4b69-986c-fc90e6810395"}} Jul 28 18:25:15.064144 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: method: > Jul 28 18:25:15.065008 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: exception: Invalid volume: volume 511b7979-40bd-4b69-986c-fc90e6810395 is already attached to instances: 1b4d9d7f-8b12-4bfa-83a0-e55a8422d754 Jul 28 18:25:15.065008 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: action_args: {'server_id': 'f7a41dc5-d258-475a-a1c1-9aad0723d5cb', 'body': {'volumeAttachment': {'volumeId': '511b7979-40bd-4b69-986c-fc90e6810395'}}} Jul 28 18:25:15.065008 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:25:15.065008 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:25:15.065008 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 28 18:25:15.065008 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 28 18:25:15.065008 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 18:25:15.065008 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 18:25:15.065008 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 28 18:25:15.065008 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 18:25:15.065008 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5067, in attach_volume Jul 28 18:25:15.065008 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 28 18:25:15.065008 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4907, in _check_volume_already_attached Jul 28 18:25:15.065008 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 28 18:25:15.065008 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 511b7979-40bd-4b69-986c-fc90e6810395 is already attached to instances: 1b4d9d7f-8b12-4bfa-83a0-e55a8422d754 Jul 28 18:25:15.065008 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:25:15.065008 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:25:15.065008 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:25:15.065008 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:25:15.066315 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:25:15.066315 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:25:15.066315 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:25:15.066315 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:25:15.066315 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:25:15.066315 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:25:15.066315 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 18:25:15.066315 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 18:25:15.066315 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 18:25:15.066315 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 18:25:15.066315 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 18:25:15.066315 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 18:25:15.066315 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 28 18:25:15.066315 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 28 18:25:15.066315 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 511b7979-40bd-4b69-986c-fc90e6810395 is already attached to instances: 1b4d9d7f-8b12-4bfa-83a0-e55a8422d754 Jul 28 18:25:15.066315 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:25:15.066315 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:25:15.066315 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:25:15.066315 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:25:15.066315 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:25:15.067636 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:25:15.067636 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:25:15.067636 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:25:15.067636 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 511b7979-40bd-4b69-986c-fc90e6810395 is already attached to instances: 1b4d9d7f-8b12-4bfa-83a0-e55a8422d754 Jul 28 18:25:15.067636 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:25:15.067636 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-8fefca3e-db96-44b1-928c-e8f2830bb681 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Returning 400 to user: Invalid volume: volume 511b7979-40bd-4b69-986c-fc90e6810395 is already attached to instances: 1b4d9d7f-8b12-4bfa-83a0-e55a8422d754 {{(pid=118453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:25:15.067636 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-8fefca3e-db96-44b1-928c-e8f2830bb681 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "POST /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.109565 Jul 28 18:25:15.067636 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 547/1100] 10.222.0.86 () {60 vars in 1323 bytes} [Thu Jul 28 18:25:14 2022] POST /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb/os-volume_attachments => generated 174 bytes in 111 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 18:25:15.072837 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-53ceb813-feea-4fdb-891b-163e11a8c2ce tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:15.073402 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-53ceb813-feea-4fdb-891b-163e11a8c2ce tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: f7a41dc5-d258-475a-a1c1-9aad0723d5cb] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:15.079565 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-53ceb813-feea-4fdb-891b-163e11a8c2ce tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:15.080022 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-53ceb813-feea-4fdb-891b-163e11a8c2ce tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:15.080795 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-53ceb813-feea-4fdb-891b-163e11a8c2ce tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:15.081348 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-53ceb813-feea-4fdb-891b-163e11a8c2ce tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:15.107337 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-53ceb813-feea-4fdb-891b-163e11a8c2ce tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: f7a41dc5-d258-475a-a1c1-9aad0723d5cb] Going to try to terminate instance {{(pid=118454) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 18:25:15.371491 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-53ceb813-feea-4fdb-891b-163e11a8c2ce tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "DELETE /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb" status: 204 len: 0 microversion: 2.1 time: 0.302203 Jul 28 18:25:15.372099 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 554/1101] 10.222.0.86 () {58 vars in 1239 bytes} [Thu Jul 28 18:25:15 2022] DELETE /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 18:25:15.380349 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-eed8d35f-fe18-4f23-8d3e-ea3a2b3f95f7 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:15.381259 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-eed8d35f-fe18-4f23-8d3e-ea3a2b3f95f7 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: f7a41dc5-d258-475a-a1c1-9aad0723d5cb] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:15.388795 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-eed8d35f-fe18-4f23-8d3e-ea3a2b3f95f7 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:15.389334 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-eed8d35f-fe18-4f23-8d3e-ea3a2b3f95f7 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:15.390123 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-eed8d35f-fe18-4f23-8d3e-ea3a2b3f95f7 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:15.390553 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-eed8d35f-fe18-4f23-8d3e-ea3a2b3f95f7 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:15.541383 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-eed8d35f-fe18-4f23-8d3e-ea3a2b3f95f7 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:25:15.549365 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-eed8d35f-fe18-4f23-8d3e-ea3a2b3f95f7 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb" status: 200 len: 1680 microversion: 2.1 time: 0.172868 Jul 28 18:25:15.553131 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 548/1102] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:25:15 2022] GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb => generated 1680 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:25:15.967706 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-f7a36696-1031-49b0-b157-780abcc26aa7 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:15.968475 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-f7a36696-1031-49b0-b157-780abcc26aa7 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] [instance: 0308fa68-38a8-43e2-8e64-6de4f4a28f73] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:15.974878 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f7a36696-1031-49b0-b157-780abcc26aa7 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:15.975326 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f7a36696-1031-49b0-b157-780abcc26aa7 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:15.976082 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f7a36696-1031-49b0-b157-780abcc26aa7 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:15.976516 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f7a36696-1031-49b0-b157-780abcc26aa7 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:16.114621 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-f7a36696-1031-49b0-b157-780abcc26aa7 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799a2726f3694d39a70cbdaed5257751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe865ae79cfc41c1a2668f91e8cf0f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:25:16.122245 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-f7a36696-1031-49b0-b157-780abcc26aa7 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] 10.222.0.86 "GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73" status: 200 len: 1358 microversion: 2.1 time: 0.159507 Jul 28 18:25:16.123182 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 555/1103] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:25:15 2022] GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:25:16.570734 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f2a084fd-ef8f-45a9-82d2-2dfbfd5186c5 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:16.571354 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f2a084fd-ef8f-45a9-82d2-2dfbfd5186c5 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: f7a41dc5-d258-475a-a1c1-9aad0723d5cb] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:16.594280 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f2a084fd-ef8f-45a9-82d2-2dfbfd5186c5 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:16.594590 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f2a084fd-ef8f-45a9-82d2-2dfbfd5186c5 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:16.595382 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f2a084fd-ef8f-45a9-82d2-2dfbfd5186c5 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:16.595830 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f2a084fd-ef8f-45a9-82d2-2dfbfd5186c5 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:16.784160 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f2a084fd-ef8f-45a9-82d2-2dfbfd5186c5 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:25:16.795292 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f2a084fd-ef8f-45a9-82d2-2dfbfd5186c5 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb" status: 200 len: 1680 microversion: 2.1 time: 0.228442 Jul 28 18:25:16.809981 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 549/1104] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:25:16 2022] GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb => generated 1680 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:25:17.151789 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-0147209c-84ab-401e-a756-e5e716fb33b8 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:17.153571 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-0147209c-84ab-401e-a756-e5e716fb33b8 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] [instance: 0308fa68-38a8-43e2-8e64-6de4f4a28f73] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:17.174542 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-0147209c-84ab-401e-a756-e5e716fb33b8 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:17.175724 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-0147209c-84ab-401e-a756-e5e716fb33b8 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:17.177310 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-0147209c-84ab-401e-a756-e5e716fb33b8 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:17.178044 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-0147209c-84ab-401e-a756-e5e716fb33b8 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:17.473241 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-0147209c-84ab-401e-a756-e5e716fb33b8 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799a2726f3694d39a70cbdaed5257751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe865ae79cfc41c1a2668f91e8cf0f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:25:17.485914 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-0147209c-84ab-401e-a756-e5e716fb33b8 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] 10.222.0.86 "GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73" status: 200 len: 1358 microversion: 2.1 time: 0.345565 Jul 28 18:25:17.489118 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 556/1105] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:25:17 2022] GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73 => generated 1358 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:25:17.598716 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-0a8c4421-39d2-4163-af90-f29b2657eb0b req-7b92f2eb-196e-4df7-9bda-822e6438a217 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0308fa68-38a8-43e2-8e64-6de4f4a28f73", "tag": "fffe897d-12c2-45ef-b241-0a4c420fa5f6"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:25:17.615227 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-0a8c4421-39d2-4163-af90-f29b2657eb0b req-7b92f2eb-196e-4df7-9bda-822e6438a217 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:17.615227 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-0a8c4421-39d2-4163-af90-f29b2657eb0b req-7b92f2eb-196e-4df7-9bda-822e6438a217 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:17.640656 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-0a8c4421-39d2-4163-af90-f29b2657eb0b req-7b92f2eb-196e-4df7-9bda-822e6438a217 service nova] Creating event network-changed:fffe897d-12c2-45ef-b241-0a4c420fa5f6 for instance 0308fa68-38a8-43e2-8e64-6de4f4a28f73 on hv-cinder-84617 Jul 28 18:25:17.646529 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-0a8c4421-39d2-4163-af90-f29b2657eb0b req-7b92f2eb-196e-4df7-9bda-822e6438a217 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051380 Jul 28 18:25:17.647526 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 550/1106] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:25:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 18:25:17.818918 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-a87125a8-3cbb-4d80-a4a0-cc53fd0711da tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:17.819533 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-a87125a8-3cbb-4d80-a4a0-cc53fd0711da tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: f7a41dc5-d258-475a-a1c1-9aad0723d5cb] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:17.827354 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a87125a8-3cbb-4d80-a4a0-cc53fd0711da tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:17.827808 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a87125a8-3cbb-4d80-a4a0-cc53fd0711da tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:17.828594 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a87125a8-3cbb-4d80-a4a0-cc53fd0711da tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:17.829053 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a87125a8-3cbb-4d80-a4a0-cc53fd0711da tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:17.989188 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-a87125a8-3cbb-4d80-a4a0-cc53fd0711da tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:25:17.997802 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-a87125a8-3cbb-4d80-a4a0-cc53fd0711da tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb" status: 200 len: 1680 microversion: 2.1 time: 0.182476 Jul 28 18:25:17.998905 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 557/1107] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:25:17 2022] GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb => generated 1680 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:25:18.507481 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-fafad877-55c5-4e6d-b041-2ece97187ed5 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:18.508289 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-fafad877-55c5-4e6d-b041-2ece97187ed5 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] [instance: 0308fa68-38a8-43e2-8e64-6de4f4a28f73] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:18.515669 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fafad877-55c5-4e6d-b041-2ece97187ed5 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:18.516120 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fafad877-55c5-4e6d-b041-2ece97187ed5 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:18.516905 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fafad877-55c5-4e6d-b041-2ece97187ed5 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:18.517372 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fafad877-55c5-4e6d-b041-2ece97187ed5 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:18.844301 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-fafad877-55c5-4e6d-b041-2ece97187ed5 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799a2726f3694d39a70cbdaed5257751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe865ae79cfc41c1a2668f91e8cf0f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:25:18.852588 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-fafad877-55c5-4e6d-b041-2ece97187ed5 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] 10.222.0.86 "GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73" status: 200 len: 1358 microversion: 2.1 time: 0.349457 Jul 28 18:25:18.853617 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 551/1108] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:25:18 2022] GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73 => generated 1358 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:25:19.021159 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-30244f06-cb93-4c60-b916-17d38a96075b tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:19.021773 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-30244f06-cb93-4c60-b916-17d38a96075b tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: f7a41dc5-d258-475a-a1c1-9aad0723d5cb] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:19.040561 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-30244f06-cb93-4c60-b916-17d38a96075b tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:19.041027 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-30244f06-cb93-4c60-b916-17d38a96075b tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:19.042359 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-30244f06-cb93-4c60-b916-17d38a96075b tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:19.042798 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-30244f06-cb93-4c60-b916-17d38a96075b tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:19.191556 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-30244f06-cb93-4c60-b916-17d38a96075b tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:25:19.201154 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-30244f06-cb93-4c60-b916-17d38a96075b tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb" status: 200 len: 1680 microversion: 2.1 time: 0.183618 Jul 28 18:25:19.201444 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 558/1109] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:25:19 2022] GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb => generated 1680 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:25:19.879580 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a964793e-12a7-4312-b510-087baf143972 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:19.880194 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-a964793e-12a7-4312-b510-087baf143972 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] [instance: 0308fa68-38a8-43e2-8e64-6de4f4a28f73] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:19.887216 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a964793e-12a7-4312-b510-087baf143972 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:19.887874 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a964793e-12a7-4312-b510-087baf143972 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:19.889051 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a964793e-12a7-4312-b510-087baf143972 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:19.889658 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a964793e-12a7-4312-b510-087baf143972 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:20.080283 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-a964793e-12a7-4312-b510-087baf143972 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799a2726f3694d39a70cbdaed5257751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe865ae79cfc41c1a2668f91e8cf0f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:25:20.094027 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-a964793e-12a7-4312-b510-087baf143972 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] 10.222.0.86 "GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73" status: 200 len: 1358 microversion: 2.1 time: 0.220654 Jul 28 18:25:20.096480 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 552/1110] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:25:19 2022] GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73 => generated 1358 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:25:20.222523 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-84febdd5-3035-461d-bfbd-b5ea6d2d69d3 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:20.223787 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-84febdd5-3035-461d-bfbd-b5ea6d2d69d3 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: f7a41dc5-d258-475a-a1c1-9aad0723d5cb] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:20.231457 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-84febdd5-3035-461d-bfbd-b5ea6d2d69d3 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:20.241275 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-84febdd5-3035-461d-bfbd-b5ea6d2d69d3 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:20.242205 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-84febdd5-3035-461d-bfbd-b5ea6d2d69d3 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:20.242683 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-84febdd5-3035-461d-bfbd-b5ea6d2d69d3 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:20.452679 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-84febdd5-3035-461d-bfbd-b5ea6d2d69d3 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:25:20.461737 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-84febdd5-3035-461d-bfbd-b5ea6d2d69d3 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb" status: 200 len: 1680 microversion: 2.1 time: 0.243113 Jul 28 18:25:20.473015 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 559/1111] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:25:20 2022] GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb => generated 1680 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:25:21.118660 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d5b1d596-6880-42e4-b245-60701142d069 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:21.121117 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-d5b1d596-6880-42e4-b245-60701142d069 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] [instance: 0308fa68-38a8-43e2-8e64-6de4f4a28f73] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:21.129678 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d5b1d596-6880-42e4-b245-60701142d069 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:21.130163 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d5b1d596-6880-42e4-b245-60701142d069 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:21.130932 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d5b1d596-6880-42e4-b245-60701142d069 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:21.131374 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d5b1d596-6880-42e4-b245-60701142d069 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:21.356837 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-d5b1d596-6880-42e4-b245-60701142d069 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799a2726f3694d39a70cbdaed5257751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe865ae79cfc41c1a2668f91e8cf0f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:25:21.356837 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-d5b1d596-6880-42e4-b245-60701142d069 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] 10.222.0.86 "GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73" status: 200 len: 1358 microversion: 2.1 time: 0.199962 Jul 28 18:25:21.356837 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 553/1112] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:25:21 2022] GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73 => generated 1358 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:25:21.483585 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-2e0ae2d6-4ceb-4065-928d-547a590a715c tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:21.485270 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-2e0ae2d6-4ceb-4065-928d-547a590a715c tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: f7a41dc5-d258-475a-a1c1-9aad0723d5cb] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:21.504548 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2e0ae2d6-4ceb-4065-928d-547a590a715c tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:21.505047 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2e0ae2d6-4ceb-4065-928d-547a590a715c tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:21.506653 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2e0ae2d6-4ceb-4065-928d-547a590a715c tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:21.507281 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2e0ae2d6-4ceb-4065-928d-547a590a715c tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:21.691260 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-2e0ae2d6-4ceb-4065-928d-547a590a715c tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:25:21.699428 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-2e0ae2d6-4ceb-4065-928d-547a590a715c tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb" status: 200 len: 1680 microversion: 2.1 time: 0.220089 Jul 28 18:25:21.699988 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 560/1113] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:25:21 2022] GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb => generated 1680 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:25:21.884807 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-ed2ab10f-e69b-4173-8997-914d2135ae26 req-ebb7acd2-e9ee-4d42-8d4a-9c269a73588a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7a41dc5-d258-475a-a1c1-9aad0723d5cb", "name": "network-vif-unplugged", "status": "completed", "tag": "aa7258bd-d420-41dc-a491-75aceff4ed8e"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:25:21.898645 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-ed2ab10f-e69b-4173-8997-914d2135ae26 req-ebb7acd2-e9ee-4d42-8d4a-9c269a73588a service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:21.899395 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-ed2ab10f-e69b-4173-8997-914d2135ae26 req-ebb7acd2-e9ee-4d42-8d4a-9c269a73588a service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:21.912750 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-ed2ab10f-e69b-4173-8997-914d2135ae26 req-ebb7acd2-e9ee-4d42-8d4a-9c269a73588a service nova] Creating event network-vif-unplugged:aa7258bd-d420-41dc-a491-75aceff4ed8e for instance f7a41dc5-d258-475a-a1c1-9aad0723d5cb on hv-cinder-84617 Jul 28 18:25:21.918037 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-ed2ab10f-e69b-4173-8997-914d2135ae26 req-ebb7acd2-e9ee-4d42-8d4a-9c269a73588a service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039276 Jul 28 18:25:21.918916 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 554/1114] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:25:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:25:22.370984 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-502256cf-050e-4aab-8e27-a57ff063a8a2 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:22.371590 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-502256cf-050e-4aab-8e27-a57ff063a8a2 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] [instance: 0308fa68-38a8-43e2-8e64-6de4f4a28f73] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:22.378237 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-502256cf-050e-4aab-8e27-a57ff063a8a2 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:22.378926 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-502256cf-050e-4aab-8e27-a57ff063a8a2 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:22.379872 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-502256cf-050e-4aab-8e27-a57ff063a8a2 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:22.380473 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-502256cf-050e-4aab-8e27-a57ff063a8a2 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:22.492524 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell0:SELECT=2 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:25:22.518919 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell0:SELECT=6 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:25:22.522324 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-502256cf-050e-4aab-8e27-a57ff063a8a2 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799a2726f3694d39a70cbdaed5257751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe865ae79cfc41c1a2668f91e8cf0f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:25:22.530281 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-502256cf-050e-4aab-8e27-a57ff063a8a2 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] 10.222.0.86 "GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73" status: 200 len: 1358 microversion: 2.1 time: 0.163663 Jul 28 18:25:22.530856 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 561/1115] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:25:22 2022] GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:25:22.722260 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-6c69c473-e08a-4cf0-8e14-f42dbfb0dd03 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:22.722983 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-6c69c473-e08a-4cf0-8e14-f42dbfb0dd03 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: f7a41dc5-d258-475a-a1c1-9aad0723d5cb] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:22.728060 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell0:SELECT=6 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:25:22.730549 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6c69c473-e08a-4cf0-8e14-f42dbfb0dd03 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:22.731000 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6c69c473-e08a-4cf0-8e14-f42dbfb0dd03 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:22.731764 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6c69c473-e08a-4cf0-8e14-f42dbfb0dd03 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:22.732209 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6c69c473-e08a-4cf0-8e14-f42dbfb0dd03 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:22.873412 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-6c69c473-e08a-4cf0-8e14-f42dbfb0dd03 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:25:22.881152 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-6c69c473-e08a-4cf0-8e14-f42dbfb0dd03 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb" status: 200 len: 1680 microversion: 2.1 time: 0.163668 Jul 28 18:25:22.881771 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 555/1116] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:25:22 2022] GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:25:23.551042 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-b5498afc-383e-4c30-9029-40f67ffbe498 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:23.551696 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-b5498afc-383e-4c30-9029-40f67ffbe498 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] [instance: 0308fa68-38a8-43e2-8e64-6de4f4a28f73] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:23.559749 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b5498afc-383e-4c30-9029-40f67ffbe498 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:23.560207 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b5498afc-383e-4c30-9029-40f67ffbe498 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:23.561005 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b5498afc-383e-4c30-9029-40f67ffbe498 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:23.561459 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b5498afc-383e-4c30-9029-40f67ffbe498 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:23.694992 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-b5498afc-383e-4c30-9029-40f67ffbe498 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799a2726f3694d39a70cbdaed5257751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe865ae79cfc41c1a2668f91e8cf0f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:25:23.703600 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-b5498afc-383e-4c30-9029-40f67ffbe498 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] 10.222.0.86 "GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73" status: 200 len: 1358 microversion: 2.1 time: 0.156575 Jul 28 18:25:23.704250 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 562/1117] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:25:23 2022] GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:25:23.904101 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-cc0ed0b6-3efc-4d54-8278-b991a6e7849b tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:23.905057 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-cc0ed0b6-3efc-4d54-8278-b991a6e7849b tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: f7a41dc5-d258-475a-a1c1-9aad0723d5cb] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:23.912526 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cc0ed0b6-3efc-4d54-8278-b991a6e7849b tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:23.913083 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cc0ed0b6-3efc-4d54-8278-b991a6e7849b tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:23.913858 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cc0ed0b6-3efc-4d54-8278-b991a6e7849b tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:23.914298 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-cc0ed0b6-3efc-4d54-8278-b991a6e7849b tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:24.058194 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-cc0ed0b6-3efc-4d54-8278-b991a6e7849b tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:25:24.067139 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-cc0ed0b6-3efc-4d54-8278-b991a6e7849b tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb" status: 200 len: 1680 microversion: 2.1 time: 0.168134 Jul 28 18:25:24.067769 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 556/1118] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:25:23 2022] GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb => generated 1680 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:25:24.728687 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-e1831915-2d50-4c17-acf8-b9bc9e49993b tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:24.729338 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-e1831915-2d50-4c17-acf8-b9bc9e49993b tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] [instance: 0308fa68-38a8-43e2-8e64-6de4f4a28f73] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:24.735802 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e1831915-2d50-4c17-acf8-b9bc9e49993b tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:24.736259 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e1831915-2d50-4c17-acf8-b9bc9e49993b tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:24.737053 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e1831915-2d50-4c17-acf8-b9bc9e49993b tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:24.737507 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e1831915-2d50-4c17-acf8-b9bc9e49993b tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:24.915940 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-e1831915-2d50-4c17-acf8-b9bc9e49993b tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799a2726f3694d39a70cbdaed5257751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe865ae79cfc41c1a2668f91e8cf0f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:25:24.924323 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-e1831915-2d50-4c17-acf8-b9bc9e49993b tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] 10.222.0.86 "GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73" status: 200 len: 1358 microversion: 2.1 time: 0.199858 Jul 28 18:25:24.924907 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 563/1119] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:25:24 2022] GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73 => generated 1358 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:25:25.088093 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-321ea789-a63e-4d78-ad56-05814a84f38b tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:25.088735 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-321ea789-a63e-4d78-ad56-05814a84f38b tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: f7a41dc5-d258-475a-a1c1-9aad0723d5cb] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:25.095277 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-321ea789-a63e-4d78-ad56-05814a84f38b tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:25.095773 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-321ea789-a63e-4d78-ad56-05814a84f38b tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:25.096541 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-321ea789-a63e-4d78-ad56-05814a84f38b tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:25.097001 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-321ea789-a63e-4d78-ad56-05814a84f38b tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:25.246806 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-321ea789-a63e-4d78-ad56-05814a84f38b tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:25:25.256246 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-321ea789-a63e-4d78-ad56-05814a84f38b tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb" status: 200 len: 1680 microversion: 2.1 time: 0.172133 Jul 28 18:25:25.257845 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 557/1120] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:25:25 2022] GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb => generated 1680 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:25:25.946127 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-37e53bce-d362-4c90-ad1a-7bea6a8ee9a6 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:25.946758 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-37e53bce-d362-4c90-ad1a-7bea6a8ee9a6 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] [instance: 0308fa68-38a8-43e2-8e64-6de4f4a28f73] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:25.954128 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-37e53bce-d362-4c90-ad1a-7bea6a8ee9a6 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:25.954579 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-37e53bce-d362-4c90-ad1a-7bea6a8ee9a6 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:25.955363 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-37e53bce-d362-4c90-ad1a-7bea6a8ee9a6 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:25.955803 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-37e53bce-d362-4c90-ad1a-7bea6a8ee9a6 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:26.093824 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-37e53bce-d362-4c90-ad1a-7bea6a8ee9a6 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799a2726f3694d39a70cbdaed5257751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe865ae79cfc41c1a2668f91e8cf0f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:25:26.102293 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-37e53bce-d362-4c90-ad1a-7bea6a8ee9a6 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] 10.222.0.86 "GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73" status: 200 len: 1358 microversion: 2.1 time: 0.159935 Jul 28 18:25:26.102875 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 564/1121] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:25:25 2022] GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:25:26.280918 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-2c877417-4a08-4638-8a4a-0a55ab48b4bb tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:26.282567 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-2c877417-4a08-4638-8a4a-0a55ab48b4bb tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: f7a41dc5-d258-475a-a1c1-9aad0723d5cb] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:26.297750 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2c877417-4a08-4638-8a4a-0a55ab48b4bb tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:26.298494 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2c877417-4a08-4638-8a4a-0a55ab48b4bb tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:26.299567 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2c877417-4a08-4638-8a4a-0a55ab48b4bb tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:26.304242 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2c877417-4a08-4638-8a4a-0a55ab48b4bb tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:26.449547 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-2c877417-4a08-4638-8a4a-0a55ab48b4bb tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:25:26.466733 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-2c877417-4a08-4638-8a4a-0a55ab48b4bb tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb" status: 200 len: 1680 microversion: 2.1 time: 0.187571 Jul 28 18:25:26.467462 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 558/1122] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:25:26 2022] GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb => generated 1680 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:25:27.122213 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-16f050f2-1d4b-4dec-9247-15652902d1fa tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:27.122805 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-16f050f2-1d4b-4dec-9247-15652902d1fa tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] [instance: 0308fa68-38a8-43e2-8e64-6de4f4a28f73] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:27.129293 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-16f050f2-1d4b-4dec-9247-15652902d1fa tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:27.129739 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-16f050f2-1d4b-4dec-9247-15652902d1fa tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:27.130491 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-16f050f2-1d4b-4dec-9247-15652902d1fa tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:27.130927 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-16f050f2-1d4b-4dec-9247-15652902d1fa tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:27.259832 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-16f050f2-1d4b-4dec-9247-15652902d1fa tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799a2726f3694d39a70cbdaed5257751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe865ae79cfc41c1a2668f91e8cf0f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:25:27.267923 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-16f050f2-1d4b-4dec-9247-15652902d1fa tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] 10.222.0.86 "GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73" status: 200 len: 1358 microversion: 2.1 time: 0.149527 Jul 28 18:25:27.268445 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 565/1123] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:25:27 2022] GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:25:27.491687 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-2b0afcfc-1e87-4181-9cfa-0322446c0d43 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:27.501325 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-2b0afcfc-1e87-4181-9cfa-0322446c0d43 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: f7a41dc5-d258-475a-a1c1-9aad0723d5cb] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:27.501325 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2b0afcfc-1e87-4181-9cfa-0322446c0d43 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:27.501325 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2b0afcfc-1e87-4181-9cfa-0322446c0d43 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:27.501325 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2b0afcfc-1e87-4181-9cfa-0322446c0d43 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:27.501732 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-2b0afcfc-1e87-4181-9cfa-0322446c0d43 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:27.634047 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-2b0afcfc-1e87-4181-9cfa-0322446c0d43 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:25:27.641570 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-2b0afcfc-1e87-4181-9cfa-0322446c0d43 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb" status: 200 len: 1680 microversion: 2.1 time: 0.153796 Jul 28 18:25:27.642144 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 559/1124] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:25:27 2022] GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:25:28.289497 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-57bc52e8-f370-4b6b-9c94-264152de1137 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:28.290111 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-57bc52e8-f370-4b6b-9c94-264152de1137 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] [instance: 0308fa68-38a8-43e2-8e64-6de4f4a28f73] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:28.297249 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-57bc52e8-f370-4b6b-9c94-264152de1137 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:28.297699 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-57bc52e8-f370-4b6b-9c94-264152de1137 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:28.298486 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-57bc52e8-f370-4b6b-9c94-264152de1137 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:28.298917 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-57bc52e8-f370-4b6b-9c94-264152de1137 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:28.426846 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-57bc52e8-f370-4b6b-9c94-264152de1137 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799a2726f3694d39a70cbdaed5257751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe865ae79cfc41c1a2668f91e8cf0f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:25:28.429901 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:25:28.434375 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-57bc52e8-f370-4b6b-9c94-264152de1137 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] 10.222.0.86 "GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73" status: 200 len: 1358 microversion: 2.1 time: 0.148941 Jul 28 18:25:28.434950 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 566/1125] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:25:28 2022] GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:25:28.663075 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-6bf5cb6c-1642-4c80-ab54-5db67d06effb tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:28.663678 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-6bf5cb6c-1642-4c80-ab54-5db67d06effb tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: f7a41dc5-d258-475a-a1c1-9aad0723d5cb] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:28.670228 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6bf5cb6c-1642-4c80-ab54-5db67d06effb tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:28.670673 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6bf5cb6c-1642-4c80-ab54-5db67d06effb tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:28.671425 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6bf5cb6c-1642-4c80-ab54-5db67d06effb tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:28.671860 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6bf5cb6c-1642-4c80-ab54-5db67d06effb tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:28.815255 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-6bf5cb6c-1642-4c80-ab54-5db67d06effb tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:25:28.827699 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-6bf5cb6c-1642-4c80-ab54-5db67d06effb tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb" status: 200 len: 1680 microversion: 2.1 time: 0.168429 Jul 28 18:25:28.828274 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 560/1126] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:25:28 2022] GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb => generated 1680 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:25:29.456087 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-5d8206f3-7432-4adf-8cbb-7cc503e9685c tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:29.456704 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-5d8206f3-7432-4adf-8cbb-7cc503e9685c tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] [instance: 0308fa68-38a8-43e2-8e64-6de4f4a28f73] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:29.463864 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-5d8206f3-7432-4adf-8cbb-7cc503e9685c tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:29.464313 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-5d8206f3-7432-4adf-8cbb-7cc503e9685c tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:29.465114 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-5d8206f3-7432-4adf-8cbb-7cc503e9685c tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:29.465556 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-5d8206f3-7432-4adf-8cbb-7cc503e9685c tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:29.593784 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-5d8206f3-7432-4adf-8cbb-7cc503e9685c tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799a2726f3694d39a70cbdaed5257751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe865ae79cfc41c1a2668f91e8cf0f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:25:29.601272 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-5d8206f3-7432-4adf-8cbb-7cc503e9685c tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] 10.222.0.86 "GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73" status: 200 len: 1358 microversion: 2.1 time: 0.149277 Jul 28 18:25:29.601849 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 567/1127] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:25:29 2022] GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:25:29.849559 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-e94a2f02-d704-45dc-8e67-2138bbd4ad28 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:29.850097 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-e94a2f02-d704-45dc-8e67-2138bbd4ad28 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: f7a41dc5-d258-475a-a1c1-9aad0723d5cb] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:29.857222 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e94a2f02-d704-45dc-8e67-2138bbd4ad28 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:29.857680 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e94a2f02-d704-45dc-8e67-2138bbd4ad28 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:29.858455 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e94a2f02-d704-45dc-8e67-2138bbd4ad28 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:29.858899 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e94a2f02-d704-45dc-8e67-2138bbd4ad28 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:29.989298 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-e94a2f02-d704-45dc-8e67-2138bbd4ad28 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:25:29.996764 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-e94a2f02-d704-45dc-8e67-2138bbd4ad28 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb" status: 200 len: 1680 microversion: 2.1 time: 0.151227 Jul 28 18:25:29.997411 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 561/1128] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:25:29 2022] GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:25:30.622481 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-7c26f507-e689-4054-8407-364572a50ef4 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:30.623094 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-7c26f507-e689-4054-8407-364572a50ef4 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] [instance: 0308fa68-38a8-43e2-8e64-6de4f4a28f73] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:30.629562 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-7c26f507-e689-4054-8407-364572a50ef4 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:30.630009 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-7c26f507-e689-4054-8407-364572a50ef4 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:30.630769 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-7c26f507-e689-4054-8407-364572a50ef4 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:30.631207 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-7c26f507-e689-4054-8407-364572a50ef4 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:30.757938 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-7c26f507-e689-4054-8407-364572a50ef4 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799a2726f3694d39a70cbdaed5257751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe865ae79cfc41c1a2668f91e8cf0f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:25:30.765892 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-7c26f507-e689-4054-8407-364572a50ef4 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] 10.222.0.86 "GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73" status: 200 len: 1358 microversion: 2.1 time: 0.147337 Jul 28 18:25:30.766463 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 568/1129] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:25:30 2022] GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73 => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:25:31.018680 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b401154d-4ec7-4989-bd1d-55941c4b2ba8 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:31.019255 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b401154d-4ec7-4989-bd1d-55941c4b2ba8 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: f7a41dc5-d258-475a-a1c1-9aad0723d5cb] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:31.026343 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b401154d-4ec7-4989-bd1d-55941c4b2ba8 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:31.026793 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b401154d-4ec7-4989-bd1d-55941c4b2ba8 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:31.027579 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b401154d-4ec7-4989-bd1d-55941c4b2ba8 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:31.028022 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b401154d-4ec7-4989-bd1d-55941c4b2ba8 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:31.160535 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b401154d-4ec7-4989-bd1d-55941c4b2ba8 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:25:31.168012 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b401154d-4ec7-4989-bd1d-55941c4b2ba8 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb" status: 200 len: 1680 microversion: 2.1 time: 0.153312 Jul 28 18:25:31.168594 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 562/1130] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:25:31 2022] GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:25:31.787421 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-92430263-b696-4045-b097-64514e4decf9 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:31.788041 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-92430263-b696-4045-b097-64514e4decf9 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] [instance: 0308fa68-38a8-43e2-8e64-6de4f4a28f73] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:31.795726 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-92430263-b696-4045-b097-64514e4decf9 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:31.796182 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-92430263-b696-4045-b097-64514e4decf9 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:31.796958 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-92430263-b696-4045-b097-64514e4decf9 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:31.797426 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-92430263-b696-4045-b097-64514e4decf9 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:31.935938 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-92430263-b696-4045-b097-64514e4decf9 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799a2726f3694d39a70cbdaed5257751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe865ae79cfc41c1a2668f91e8cf0f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:25:31.943384 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-92430263-b696-4045-b097-64514e4decf9 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] 10.222.0.86 "GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73" status: 200 len: 1358 microversion: 2.1 time: 0.159815 Jul 28 18:25:31.943955 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 569/1131] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:25:31 2022] GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:25:32.192238 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-46b9cc5b-9998-427b-a73f-1059ead825e2 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:32.192238 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-46b9cc5b-9998-427b-a73f-1059ead825e2 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: f7a41dc5-d258-475a-a1c1-9aad0723d5cb] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:32.196484 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-46b9cc5b-9998-427b-a73f-1059ead825e2 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:32.196934 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-46b9cc5b-9998-427b-a73f-1059ead825e2 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:32.197741 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-46b9cc5b-9998-427b-a73f-1059ead825e2 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:32.198282 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-46b9cc5b-9998-427b-a73f-1059ead825e2 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:32.327081 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-46b9cc5b-9998-427b-a73f-1059ead825e2 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:25:32.330695 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=100 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:25:32.335273 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-46b9cc5b-9998-427b-a73f-1059ead825e2 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb" status: 200 len: 1680 microversion: 2.1 time: 0.150577 Jul 28 18:25:32.335842 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 563/1132] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:25:32 2022] GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:25:32.965185 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-92a85e5e-f0ed-447c-a1d2-bbae2b90ee8f tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:32.965798 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-92a85e5e-f0ed-447c-a1d2-bbae2b90ee8f tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] [instance: 0308fa68-38a8-43e2-8e64-6de4f4a28f73] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:32.972380 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-92a85e5e-f0ed-447c-a1d2-bbae2b90ee8f tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:32.972831 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-92a85e5e-f0ed-447c-a1d2-bbae2b90ee8f tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:32.973612 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-92a85e5e-f0ed-447c-a1d2-bbae2b90ee8f tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:32.974048 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-92a85e5e-f0ed-447c-a1d2-bbae2b90ee8f tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:33.102526 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-92a85e5e-f0ed-447c-a1d2-bbae2b90ee8f tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799a2726f3694d39a70cbdaed5257751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe865ae79cfc41c1a2668f91e8cf0f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:25:33.109998 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-92a85e5e-f0ed-447c-a1d2-bbae2b90ee8f tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] 10.222.0.86 "GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73" status: 200 len: 1358 microversion: 2.1 time: 0.149193 Jul 28 18:25:33.110558 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 570/1133] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:25:32 2022] GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:25:33.356372 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-35688dbe-c024-4195-891c-390b11ac9eac tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:33.357020 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-35688dbe-c024-4195-891c-390b11ac9eac tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: f7a41dc5-d258-475a-a1c1-9aad0723d5cb] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:33.363713 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-35688dbe-c024-4195-891c-390b11ac9eac tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:33.364164 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-35688dbe-c024-4195-891c-390b11ac9eac tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:33.364920 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-35688dbe-c024-4195-891c-390b11ac9eac tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:33.365383 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-35688dbe-c024-4195-891c-390b11ac9eac tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:33.493505 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-35688dbe-c024-4195-891c-390b11ac9eac tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:25:33.501606 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-35688dbe-c024-4195-891c-390b11ac9eac tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb" status: 200 len: 1680 microversion: 2.1 time: 0.149427 Jul 28 18:25:33.502190 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 564/1134] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:25:33 2022] GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:25:34.130661 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-b857edba-a813-40a8-89c5-2af070b7cf74 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:34.131295 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-b857edba-a813-40a8-89c5-2af070b7cf74 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] [instance: 0308fa68-38a8-43e2-8e64-6de4f4a28f73] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:34.138647 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b857edba-a813-40a8-89c5-2af070b7cf74 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:34.139103 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b857edba-a813-40a8-89c5-2af070b7cf74 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:34.139902 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b857edba-a813-40a8-89c5-2af070b7cf74 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:34.140365 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b857edba-a813-40a8-89c5-2af070b7cf74 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:34.267312 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-b857edba-a813-40a8-89c5-2af070b7cf74 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799a2726f3694d39a70cbdaed5257751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe865ae79cfc41c1a2668f91e8cf0f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:25:34.274755 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-b857edba-a813-40a8-89c5-2af070b7cf74 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] 10.222.0.86 "GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73" status: 200 len: 1358 microversion: 2.1 time: 0.148103 Jul 28 18:25:34.275318 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 571/1135] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:25:34 2022] GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:25:34.525170 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-6bbeadc4-d4c5-4fc9-b473-d5dee7cb79ea tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:34.525784 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-6bbeadc4-d4c5-4fc9-b473-d5dee7cb79ea tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: f7a41dc5-d258-475a-a1c1-9aad0723d5cb] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:34.532496 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6bbeadc4-d4c5-4fc9-b473-d5dee7cb79ea tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:34.532941 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6bbeadc4-d4c5-4fc9-b473-d5dee7cb79ea tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:34.533728 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6bbeadc4-d4c5-4fc9-b473-d5dee7cb79ea tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:34.534163 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6bbeadc4-d4c5-4fc9-b473-d5dee7cb79ea tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:34.674677 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-6bbeadc4-d4c5-4fc9-b473-d5dee7cb79ea tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:25:34.682813 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-6bbeadc4-d4c5-4fc9-b473-d5dee7cb79ea tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb" status: 200 len: 1680 microversion: 2.1 time: 0.162008 Jul 28 18:25:34.683381 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 565/1136] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:25:34 2022] GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:25:35.296183 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-024b1877-bc09-4613-b86a-e2ef63a039ac tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:35.297192 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-024b1877-bc09-4613-b86a-e2ef63a039ac tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] [instance: 0308fa68-38a8-43e2-8e64-6de4f4a28f73] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:35.304732 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-024b1877-bc09-4613-b86a-e2ef63a039ac tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:35.305214 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-024b1877-bc09-4613-b86a-e2ef63a039ac tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:35.305974 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-024b1877-bc09-4613-b86a-e2ef63a039ac tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:35.306403 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-024b1877-bc09-4613-b86a-e2ef63a039ac tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:35.433661 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-024b1877-bc09-4613-b86a-e2ef63a039ac tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799a2726f3694d39a70cbdaed5257751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe865ae79cfc41c1a2668f91e8cf0f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:25:35.441013 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-024b1877-bc09-4613-b86a-e2ef63a039ac tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] 10.222.0.86 "GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73" status: 200 len: 1358 microversion: 2.1 time: 0.148756 Jul 28 18:25:35.441569 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 572/1137] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:25:35 2022] GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:25:35.703541 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-c73d7b20-3d55-4f61-9c04-21d3a6f3fdbb tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:35.704163 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-c73d7b20-3d55-4f61-9c04-21d3a6f3fdbb tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: f7a41dc5-d258-475a-a1c1-9aad0723d5cb] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:35.710944 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c73d7b20-3d55-4f61-9c04-21d3a6f3fdbb tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:35.711395 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c73d7b20-3d55-4f61-9c04-21d3a6f3fdbb tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:35.712166 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c73d7b20-3d55-4f61-9c04-21d3a6f3fdbb tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:35.712616 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c73d7b20-3d55-4f61-9c04-21d3a6f3fdbb tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:35.846448 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-c73d7b20-3d55-4f61-9c04-21d3a6f3fdbb tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:25:35.854879 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-c73d7b20-3d55-4f61-9c04-21d3a6f3fdbb tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb" status: 200 len: 1680 microversion: 2.1 time: 0.155358 Jul 28 18:25:35.855456 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 566/1138] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:25:35 2022] GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:25:36.462155 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-6b313486-eeb4-40ba-a046-5d65fc9b150f tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:36.462775 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-6b313486-eeb4-40ba-a046-5d65fc9b150f tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] [instance: 0308fa68-38a8-43e2-8e64-6de4f4a28f73] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:36.469847 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-6b313486-eeb4-40ba-a046-5d65fc9b150f tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:36.470300 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-6b313486-eeb4-40ba-a046-5d65fc9b150f tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:36.471067 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-6b313486-eeb4-40ba-a046-5d65fc9b150f tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:36.471507 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-6b313486-eeb4-40ba-a046-5d65fc9b150f tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:36.602224 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-6b313486-eeb4-40ba-a046-5d65fc9b150f tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799a2726f3694d39a70cbdaed5257751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe865ae79cfc41c1a2668f91e8cf0f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:25:36.610683 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-6b313486-eeb4-40ba-a046-5d65fc9b150f tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] 10.222.0.86 "GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73" status: 200 len: 1358 microversion: 2.1 time: 0.152660 Jul 28 18:25:36.611265 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 573/1139] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:25:36 2022] GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:25:36.875680 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-1b0fea60-5740-4e75-9afa-70d540f20756 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:36.876294 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-1b0fea60-5740-4e75-9afa-70d540f20756 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: f7a41dc5-d258-475a-a1c1-9aad0723d5cb] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:36.883024 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1b0fea60-5740-4e75-9afa-70d540f20756 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:36.883473 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1b0fea60-5740-4e75-9afa-70d540f20756 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:36.884237 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1b0fea60-5740-4e75-9afa-70d540f20756 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:36.884676 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1b0fea60-5740-4e75-9afa-70d540f20756 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:37.015338 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-1b0fea60-5740-4e75-9afa-70d540f20756 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:25:37.023290 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-1b0fea60-5740-4e75-9afa-70d540f20756 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb" status: 200 len: 1680 microversion: 2.1 time: 0.151467 Jul 28 18:25:37.037823 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 567/1140] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:25:36 2022] GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:25:37.635838 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-fbed0499-209b-458d-9248-c93ced2f51d9 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:37.636469 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-fbed0499-209b-458d-9248-c93ced2f51d9 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] [instance: 0308fa68-38a8-43e2-8e64-6de4f4a28f73] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:37.642973 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-fbed0499-209b-458d-9248-c93ced2f51d9 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:37.643436 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-fbed0499-209b-458d-9248-c93ced2f51d9 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:37.644213 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-fbed0499-209b-458d-9248-c93ced2f51d9 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:37.644653 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-fbed0499-209b-458d-9248-c93ced2f51d9 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:37.783175 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-fbed0499-209b-458d-9248-c93ced2f51d9 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799a2726f3694d39a70cbdaed5257751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe865ae79cfc41c1a2668f91e8cf0f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:25:37.790733 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-fbed0499-209b-458d-9248-c93ced2f51d9 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] 10.222.0.86 "GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73" status: 200 len: 1358 microversion: 2.1 time: 0.158901 Jul 28 18:25:37.791848 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 574/1141] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:25:37 2022] GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:25:37.886451 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-13f1556c-98b3-4402-81e1-86bb19b4dacd req-9301fc3b-f57b-4b8e-a8ac-174755f44fd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7a41dc5-d258-475a-a1c1-9aad0723d5cb", "name": "network-vif-deleted", "tag": "aa7258bd-d420-41dc-a491-75aceff4ed8e"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:25:37.896988 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-13f1556c-98b3-4402-81e1-86bb19b4dacd req-9301fc3b-f57b-4b8e-a8ac-174755f44fd3 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:37.897573 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-13f1556c-98b3-4402-81e1-86bb19b4dacd req-9301fc3b-f57b-4b8e-a8ac-174755f44fd3 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:37.909916 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-13f1556c-98b3-4402-81e1-86bb19b4dacd req-9301fc3b-f57b-4b8e-a8ac-174755f44fd3 service nova] Creating event network-vif-deleted:aa7258bd-d420-41dc-a491-75aceff4ed8e for instance f7a41dc5-d258-475a-a1c1-9aad0723d5cb on hv-cinder-84617 Jul 28 18:25:37.915009 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-13f1556c-98b3-4402-81e1-86bb19b4dacd req-9301fc3b-f57b-4b8e-a8ac-174755f44fd3 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034665 Jul 28 18:25:37.915690 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 568/1142] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:25:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 18:25:38.051762 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-3833cdd0-a8f3-4a59-b3c8-5e33a84ee7e7 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:38.052719 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-3833cdd0-a8f3-4a59-b3c8-5e33a84ee7e7 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: f7a41dc5-d258-475a-a1c1-9aad0723d5cb] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:38.060461 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-3833cdd0-a8f3-4a59-b3c8-5e33a84ee7e7 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:38.061008 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-3833cdd0-a8f3-4a59-b3c8-5e33a84ee7e7 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:38.062032 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-3833cdd0-a8f3-4a59-b3c8-5e33a84ee7e7 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:38.062730 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-3833cdd0-a8f3-4a59-b3c8-5e33a84ee7e7 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:38.136586 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-3833cdd0-a8f3-4a59-b3c8-5e33a84ee7e7 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:25:38.154704 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-3833cdd0-a8f3-4a59-b3c8-5e33a84ee7e7 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb" status: 200 len: 1324 microversion: 2.1 time: 0.113549 Jul 28 18:25:38.155477 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 575/1143] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:25:38 2022] GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb => generated 1324 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:25:38.814023 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f3261974-a503-4166-9f33-72ea580babd6 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:38.814795 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f3261974-a503-4166-9f33-72ea580babd6 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] [instance: 0308fa68-38a8-43e2-8e64-6de4f4a28f73] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:38.821612 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f3261974-a503-4166-9f33-72ea580babd6 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:38.822131 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f3261974-a503-4166-9f33-72ea580babd6 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:38.823009 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f3261974-a503-4166-9f33-72ea580babd6 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:38.823453 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f3261974-a503-4166-9f33-72ea580babd6 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:38.972998 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f3261974-a503-4166-9f33-72ea580babd6 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799a2726f3694d39a70cbdaed5257751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe865ae79cfc41c1a2668f91e8cf0f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:25:38.981230 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f3261974-a503-4166-9f33-72ea580babd6 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] 10.222.0.86 "GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73" status: 200 len: 1358 microversion: 2.1 time: 0.171510 Jul 28 18:25:38.981812 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 569/1144] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:25:38 2022] GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:25:39.176531 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-b41ed0e0-cbb3-45de-891f-ae9069925915 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:39.177102 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-b41ed0e0-cbb3-45de-891f-ae9069925915 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: f7a41dc5-d258-475a-a1c1-9aad0723d5cb] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:39.183672 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b41ed0e0-cbb3-45de-891f-ae9069925915 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:39.184115 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b41ed0e0-cbb3-45de-891f-ae9069925915 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:39.184941 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b41ed0e0-cbb3-45de-891f-ae9069925915 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:39.185420 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b41ed0e0-cbb3-45de-891f-ae9069925915 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:39.217946 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b41ed0e0-cbb3-45de-891f-ae9069925915 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:39.218390 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b41ed0e0-cbb3-45de-891f-ae9069925915 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:39.218838 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.objects.instance [None req-b41ed0e0-cbb3-45de-891f-ae9069925915 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lazy-loading 'fault' on Instance uuid f7a41dc5-d258-475a-a1c1-9aad0723d5cb {{(pid=118454) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:25:39.262509 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-b41ed0e0-cbb3-45de-891f-ae9069925915 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:25:39.270142 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-b41ed0e0-cbb3-45de-891f-ae9069925915 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb" status: 200 len: 1329 microversion: 2.1 time: 0.097777 Jul 28 18:25:39.270754 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 576/1145] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:25:39 2022] GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb => generated 1329 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:25:40.001014 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-4a5b426d-b877-46cc-bb7e-78599e103c6b tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:40.001633 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-4a5b426d-b877-46cc-bb7e-78599e103c6b tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] [instance: 0308fa68-38a8-43e2-8e64-6de4f4a28f73] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:40.008124 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4a5b426d-b877-46cc-bb7e-78599e103c6b tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:40.008707 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4a5b426d-b877-46cc-bb7e-78599e103c6b tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:40.009514 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4a5b426d-b877-46cc-bb7e-78599e103c6b tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:40.010461 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4a5b426d-b877-46cc-bb7e-78599e103c6b tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:40.139655 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-4a5b426d-b877-46cc-bb7e-78599e103c6b tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799a2726f3694d39a70cbdaed5257751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe865ae79cfc41c1a2668f91e8cf0f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:25:40.147339 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-4a5b426d-b877-46cc-bb7e-78599e103c6b tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] 10.222.0.86 "GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73" status: 200 len: 1358 microversion: 2.1 time: 0.150111 Jul 28 18:25:40.147922 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 570/1146] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:25:39 2022] GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:25:40.292098 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-9ba1be31-fed5-45c3-ad29-ea492c563f44 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:40.292839 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-9ba1be31-fed5-45c3-ad29-ea492c563f44 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: f7a41dc5-d258-475a-a1c1-9aad0723d5cb] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:40.300034 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-9ba1be31-fed5-45c3-ad29-ea492c563f44 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:40.300921 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-9ba1be31-fed5-45c3-ad29-ea492c563f44 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:40.301972 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-9ba1be31-fed5-45c3-ad29-ea492c563f44 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:40.302419 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-9ba1be31-fed5-45c3-ad29-ea492c563f44 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:40.337327 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-9ba1be31-fed5-45c3-ad29-ea492c563f44 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:40.337763 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-9ba1be31-fed5-45c3-ad29-ea492c563f44 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:40.338215 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.objects.instance [None req-9ba1be31-fed5-45c3-ad29-ea492c563f44 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lazy-loading 'fault' on Instance uuid f7a41dc5-d258-475a-a1c1-9aad0723d5cb {{(pid=118454) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:25:40.378680 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-9ba1be31-fed5-45c3-ad29-ea492c563f44 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:25:40.386644 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-9ba1be31-fed5-45c3-ad29-ea492c563f44 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb" status: 200 len: 1329 microversion: 2.1 time: 0.098735 Jul 28 18:25:40.387217 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 577/1147] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:25:40 2022] GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb => generated 1329 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:25:41.168414 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-dc345b9c-a032-4e34-ac89-eb30fadd79a0 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:41.169104 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-dc345b9c-a032-4e34-ac89-eb30fadd79a0 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] [instance: 0308fa68-38a8-43e2-8e64-6de4f4a28f73] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:41.175935 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dc345b9c-a032-4e34-ac89-eb30fadd79a0 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:41.176715 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dc345b9c-a032-4e34-ac89-eb30fadd79a0 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:41.177276 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dc345b9c-a032-4e34-ac89-eb30fadd79a0 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:41.177719 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dc345b9c-a032-4e34-ac89-eb30fadd79a0 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:41.326108 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-dc345b9c-a032-4e34-ac89-eb30fadd79a0 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799a2726f3694d39a70cbdaed5257751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe865ae79cfc41c1a2668f91e8cf0f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:25:41.335064 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-dc345b9c-a032-4e34-ac89-eb30fadd79a0 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] 10.222.0.86 "GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73" status: 200 len: 1358 microversion: 2.1 time: 0.170803 Jul 28 18:25:41.335858 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 571/1148] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:25:41 2022] GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:25:41.407041 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-ee834a50-ef65-4afc-9aec-38777e3b6e93 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:41.407695 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-ee834a50-ef65-4afc-9aec-38777e3b6e93 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: f7a41dc5-d258-475a-a1c1-9aad0723d5cb] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:41.414212 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ee834a50-ef65-4afc-9aec-38777e3b6e93 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:41.414666 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ee834a50-ef65-4afc-9aec-38777e3b6e93 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:41.415440 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ee834a50-ef65-4afc-9aec-38777e3b6e93 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:41.416421 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ee834a50-ef65-4afc-9aec-38777e3b6e93 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:41.430547 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.wsgi [None req-ee834a50-ef65-4afc-9aec-38777e3b6e93 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] HTTP exception thrown: Instance f7a41dc5-d258-475a-a1c1-9aad0723d5cb could not be found. Jul 28 18:25:41.433401 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-ee834a50-ef65-4afc-9aec-38777e3b6e93 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Request method failure captured: Jul 28 18:25:41.433401 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: request: GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb HTTP/1.1 Jul 28 18:25:41.433401 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Accept: application/json Jul 28 18:25:41.433401 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Accept-Encoding: identity Jul 28 18:25:41.433401 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Connection: close Jul 28 18:25:41.433401 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Content-Length: 0 Jul 28 18:25:41.433401 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Content-Type: application/json Jul 28 18:25:41.433401 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Host: 10.222.0.86 Jul 28 18:25:41.433401 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Openstack-System-Scope: None Jul 28 18:25:41.433401 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: User-Agent: python-urllib3/1.26.10 Jul 28 18:25:41.433401 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Auth-Token: gAAAAABi4tOBTGRF9y9OAlefXy84t2lwOcq7Yp99X6H1ahc3ofs3Ehb5kBGF_9CYSBI80Rx8VFnnn80tQOz0U481VovOm_qAsLcyBFR5gizgfkClDfG1sybWskPJqHUNFOgadZvxg94hprAbcyZjmqgKLYfGkC4nDrgrf7oV07qvZWjTmYx3f6M Jul 28 18:25:41.433401 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Domain-Id: None Jul 28 18:25:41.433401 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Domain-Name: None Jul 28 18:25:41.433401 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Identity-Status: Confirmed Jul 28 18:25:41.433401 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Is-Admin-Project: True Jul 28 18:25:41.433401 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Domain-Id: default Jul 28 18:25:41.433401 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Domain-Name: Default Jul 28 18:25:41.433401 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Id: 104313ce72c94ea68c8cd3ee7f0cab2e Jul 28 18:25:41.433401 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Name: tempest-AttachVolumeNegativeTest-908754065 Jul 28 18:25:41.433401 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Role: member,reader Jul 28 18:25:41.433401 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Roles: member,reader Jul 28 18:25:41.435110 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_104313ce72c94ea68c8cd3ee7f0cab2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/104313ce72c94ea68c8cd3ee7f0cab2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/104313ce72c94ea68c8cd3ee7f0cab2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/104313ce72c94ea68c8cd3ee7f0cab2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}] Jul 28 18:25:41.435110 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant: tempest-AttachVolumeNegativeTest-908754065 Jul 28 18:25:41.435110 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant-Id: 104313ce72c94ea68c8cd3ee7f0cab2e Jul 28 18:25:41.435110 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-908754065 Jul 28 18:25:41.435110 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User: tempest-AttachVolumeNegativeTest-908754065-project Jul 28 18:25:41.435110 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Domain-Id: default Jul 28 18:25:41.435110 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Domain-Name: Default Jul 28 18:25:41.435110 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Id: e2b1f1c4bb2747e0845cdc2991e53b09 Jul 28 18:25:41.435110 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Name: tempest-AttachVolumeNegativeTest-908754065-project Jul 28 18:25:41.435110 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: method: > Jul 28 18:25:41.435110 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: exception: Instance f7a41dc5-d258-475a-a1c1-9aad0723d5cb could not be found. Jul 28 18:25:41.435110 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: action_args: {'id': 'f7a41dc5-d258-475a-a1c1-9aad0723d5cb'} Jul 28 18:25:41.436029 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:25:41.436029 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:25:41.436029 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:25:41.436029 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:25:41.436029 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:25:41.436029 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:25:41.436029 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:25:41.436029 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:25:41.436029 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:25:41.436029 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:25:41.436029 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7a41dc5-d258-475a-a1c1-9aad0723d5cb could not be found. Jul 28 18:25:41.436029 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:25:41.436029 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:25:41.436029 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:25:41.436029 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:25:41.436029 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:25:41.436029 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:25:41.436029 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:25:41.436029 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:25:41.436029 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:25:41.437754 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:25:41.437754 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 18:25:41.437754 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 18:25:41.437754 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:25:41.437754 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:25:41.437754 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:25:41.437754 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:25:41.437754 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7a41dc5-d258-475a-a1c1-9aad0723d5cb could not be found. Jul 28 18:25:41.437754 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:25:41.437754 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:25:41.437754 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:25:41.437754 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:25:41.437754 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:25:41.437754 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:25:41.437754 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:25:41.437754 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:25:41.437754 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7a41dc5-d258-475a-a1c1-9aad0723d5cb could not be found. Jul 28 18:25:41.437754 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:25:41.439278 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-ee834a50-ef65-4afc-9aec-38777e3b6e93 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Returning 404 to user: Instance f7a41dc5-d258-475a-a1c1-9aad0723d5cb could not be found. {{(pid=118454) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:25:41.439278 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-ee834a50-ef65-4afc-9aec-38777e3b6e93 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb" status: 404 len: 111 microversion: 2.1 time: 0.031706 Jul 28 18:25:41.439278 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 578/1149] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:25:41 2022] GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:25:41.444515 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f0285379-95b2-43f6-9735-9166988666b8 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '.version_select at 0x7f6fe6d89820>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:41.536107 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f0285379-95b2-43f6-9735-9166988666b8 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-211244545" status: 202 len: 0 microversion: 2.1 time: 0.095365 Jul 28 18:25:41.536716 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 572/1150] 10.222.0.86 () {58 vars in 1218 bytes} [Thu Jul 28 18:25:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-211244545 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 18:25:42.356470 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-50cd9115-317b-4e53-907c-402e2d3d1736 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:42.357165 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-50cd9115-317b-4e53-907c-402e2d3d1736 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] [instance: 0308fa68-38a8-43e2-8e64-6de4f4a28f73] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:42.359070 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:25:42.363900 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-50cd9115-317b-4e53-907c-402e2d3d1736 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:42.364360 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-50cd9115-317b-4e53-907c-402e2d3d1736 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:42.365178 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-50cd9115-317b-4e53-907c-402e2d3d1736 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:42.365618 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-50cd9115-317b-4e53-907c-402e2d3d1736 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:42.389527 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-9bfd5e57-a501-4416-adff-645edf11e76e tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:42.390111 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-9bfd5e57-a501-4416-adff-645edf11e76e tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: 1b4d9d7f-8b12-4bfa-83a0-e55a8422d754] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:42.397473 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9bfd5e57-a501-4416-adff-645edf11e76e tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:42.397932 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9bfd5e57-a501-4416-adff-645edf11e76e tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:42.398704 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9bfd5e57-a501-4416-adff-645edf11e76e tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:42.399150 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9bfd5e57-a501-4416-adff-645edf11e76e tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:42.483020 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.objects.instance [None req-9bfd5e57-a501-4416-adff-645edf11e76e tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lazy-loading 'services' on Instance uuid 1b4d9d7f-8b12-4bfa-83a0-e55a8422d754 {{(pid=118453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:25:42.510976 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-50cd9115-317b-4e53-907c-402e2d3d1736 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799a2726f3694d39a70cbdaed5257751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe865ae79cfc41c1a2668f91e8cf0f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:25:42.522925 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-50cd9115-317b-4e53-907c-402e2d3d1736 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] 10.222.0.86 "GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73" status: 200 len: 1358 microversion: 2.1 time: 0.170344 Jul 28 18:25:42.524027 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 579/1151] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:25:42 2022] GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:25:42.678123 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-9bfd5e57-a501-4416-adff-645edf11e76e tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "DELETE /compute/v2.1/servers/1b4d9d7f-8b12-4bfa-83a0-e55a8422d754/os-volume_attachments/511b7979-40bd-4b69-986c-fc90e6810395" status: 202 len: 0 microversion: 2.1 time: 0.293531 Jul 28 18:25:42.678866 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 573/1152] 10.222.0.86 () {58 vars in 1416 bytes} [Thu Jul 28 18:25:42 2022] DELETE /compute/v2.1/servers/1b4d9d7f-8b12-4bfa-83a0-e55a8422d754/os-volume_attachments/511b7979-40bd-4b69-986c-fc90e6810395 => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 18:25:42.691975 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-290b3138-8a88-46e1-8054-da60ee7e7234 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:42.694599 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-290b3138-8a88-46e1-8054-da60ee7e7234 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: 1b4d9d7f-8b12-4bfa-83a0-e55a8422d754] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:42.701899 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-290b3138-8a88-46e1-8054-da60ee7e7234 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:42.702533 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-290b3138-8a88-46e1-8054-da60ee7e7234 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:42.703400 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-290b3138-8a88-46e1-8054-da60ee7e7234 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:42.703851 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-290b3138-8a88-46e1-8054-da60ee7e7234 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:42.738119 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-290b3138-8a88-46e1-8054-da60ee7e7234 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/1b4d9d7f-8b12-4bfa-83a0-e55a8422d754/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053885 Jul 28 18:25:42.740047 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 580/1153] 10.222.0.86 () {58 vars in 1302 bytes} [Thu Jul 28 18:25:42 2022] GET /compute/v2.1/servers/1b4d9d7f-8b12-4bfa-83a0-e55a8422d754/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:25:43.544865 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-8a1be7a3-588a-483e-bb30-1f4041cd5242 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:43.545598 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-8a1be7a3-588a-483e-bb30-1f4041cd5242 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] [instance: 0308fa68-38a8-43e2-8e64-6de4f4a28f73] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:43.547570 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:25:43.552569 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8a1be7a3-588a-483e-bb30-1f4041cd5242 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:43.553052 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8a1be7a3-588a-483e-bb30-1f4041cd5242 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:43.553823 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8a1be7a3-588a-483e-bb30-1f4041cd5242 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:43.554321 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8a1be7a3-588a-483e-bb30-1f4041cd5242 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:43.688101 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8a1be7a3-588a-483e-bb30-1f4041cd5242 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799a2726f3694d39a70cbdaed5257751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe865ae79cfc41c1a2668f91e8cf0f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:25:43.696061 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-8a1be7a3-588a-483e-bb30-1f4041cd5242 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] 10.222.0.86 "GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73" status: 200 len: 1358 microversion: 2.1 time: 0.156058 Jul 28 18:25:43.696676 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 574/1154] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:25:43 2022] GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:25:43.752368 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-c9da7539-0883-45a2-9642-0d5914e534a2 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:43.754675 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-c9da7539-0883-45a2-9642-0d5914e534a2 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: 1b4d9d7f-8b12-4bfa-83a0-e55a8422d754] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:43.761301 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c9da7539-0883-45a2-9642-0d5914e534a2 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:43.762273 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c9da7539-0883-45a2-9642-0d5914e534a2 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:43.763048 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c9da7539-0883-45a2-9642-0d5914e534a2 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:43.763487 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c9da7539-0883-45a2-9642-0d5914e534a2 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:43.793354 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-c9da7539-0883-45a2-9642-0d5914e534a2 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/1b4d9d7f-8b12-4bfa-83a0-e55a8422d754/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045218 Jul 28 18:25:43.793915 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 581/1155] 10.222.0.86 () {58 vars in 1302 bytes} [Thu Jul 28 18:25:43 2022] GET /compute/v2.1/servers/1b4d9d7f-8b12-4bfa-83a0-e55a8422d754/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:25:44.072060 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-f526615e-29c4-4b0b-8de7-5671d30488bc req-aae64a03-702f-4bb8-ab19-d5abfbe085cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0308fa68-38a8-43e2-8e64-6de4f4a28f73", "name": "network-vif-plugged", "status": "completed", "tag": "fffe897d-12c2-45ef-b241-0a4c420fa5f6"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:25:44.081956 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-f526615e-29c4-4b0b-8de7-5671d30488bc req-aae64a03-702f-4bb8-ab19-d5abfbe085cd service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:44.082453 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-f526615e-29c4-4b0b-8de7-5671d30488bc req-aae64a03-702f-4bb8-ab19-d5abfbe085cd service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:44.097132 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-f526615e-29c4-4b0b-8de7-5671d30488bc req-aae64a03-702f-4bb8-ab19-d5abfbe085cd service nova] Creating event network-vif-plugged:fffe897d-12c2-45ef-b241-0a4c420fa5f6 for instance 0308fa68-38a8-43e2-8e64-6de4f4a28f73 on hv-cinder-84617 Jul 28 18:25:44.102180 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-f526615e-29c4-4b0b-8de7-5671d30488bc req-aae64a03-702f-4bb8-ab19-d5abfbe085cd service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033993 Jul 28 18:25:44.103038 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 575/1156] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:25:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:25:44.718064 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-28b2778a-9147-489e-8084-35b8cce8db9b tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:44.718696 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-28b2778a-9147-489e-8084-35b8cce8db9b tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] [instance: 0308fa68-38a8-43e2-8e64-6de4f4a28f73] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:44.724822 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-28b2778a-9147-489e-8084-35b8cce8db9b tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:44.725292 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-28b2778a-9147-489e-8084-35b8cce8db9b tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:44.732168 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-28b2778a-9147-489e-8084-35b8cce8db9b tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:44.732168 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-28b2778a-9147-489e-8084-35b8cce8db9b tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:44.806666 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-1b128b93-a57c-45a2-854a-1cff32e1c191 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:44.809724 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-1b128b93-a57c-45a2-854a-1cff32e1c191 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: 1b4d9d7f-8b12-4bfa-83a0-e55a8422d754] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:44.816523 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1b128b93-a57c-45a2-854a-1cff32e1c191 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:44.817041 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1b128b93-a57c-45a2-854a-1cff32e1c191 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:44.817829 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1b128b93-a57c-45a2-854a-1cff32e1c191 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:44.818299 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1b128b93-a57c-45a2-854a-1cff32e1c191 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:44.848303 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-1b128b93-a57c-45a2-854a-1cff32e1c191 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/1b4d9d7f-8b12-4bfa-83a0-e55a8422d754/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046219 Jul 28 18:25:44.848866 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 576/1157] 10.222.0.86 () {58 vars in 1302 bytes} [Thu Jul 28 18:25:44 2022] GET /compute/v2.1/servers/1b4d9d7f-8b12-4bfa-83a0-e55a8422d754/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 18:25:44.855421 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-28b2778a-9147-489e-8084-35b8cce8db9b tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799a2726f3694d39a70cbdaed5257751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe865ae79cfc41c1a2668f91e8cf0f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:25:44.863423 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-28b2778a-9147-489e-8084-35b8cce8db9b tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] 10.222.0.86 "GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73" status: 200 len: 1358 microversion: 2.1 time: 0.149269 Jul 28 18:25:44.864068 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 582/1158] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:25:44 2022] GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:25:44.910657 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a56bb62a-4b7a-4dd8-ba80-4b0bca0cc42a tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:44.911171 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-a56bb62a-4b7a-4dd8-ba80-4b0bca0cc42a tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: 1b4d9d7f-8b12-4bfa-83a0-e55a8422d754] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:44.917213 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a56bb62a-4b7a-4dd8-ba80-4b0bca0cc42a tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:44.917659 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a56bb62a-4b7a-4dd8-ba80-4b0bca0cc42a tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:44.918433 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a56bb62a-4b7a-4dd8-ba80-4b0bca0cc42a tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:44.918864 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a56bb62a-4b7a-4dd8-ba80-4b0bca0cc42a tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:44.945263 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-a56bb62a-4b7a-4dd8-ba80-4b0bca0cc42a tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: 1b4d9d7f-8b12-4bfa-83a0-e55a8422d754] Going to try to terminate instance {{(pid=118453) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 18:25:45.283599 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-a56bb62a-4b7a-4dd8-ba80-4b0bca0cc42a tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "DELETE /compute/v2.1/servers/1b4d9d7f-8b12-4bfa-83a0-e55a8422d754" status: 204 len: 0 microversion: 2.1 time: 0.376788 Jul 28 18:25:45.284195 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 577/1159] 10.222.0.86 () {58 vars in 1239 bytes} [Thu Jul 28 18:25:44 2022] DELETE /compute/v2.1/servers/1b4d9d7f-8b12-4bfa-83a0-e55a8422d754 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 18:25:45.293344 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-9e9faae7-4f55-41a2-90fb-b0967236da6f tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:45.293898 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-9e9faae7-4f55-41a2-90fb-b0967236da6f tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: 1b4d9d7f-8b12-4bfa-83a0-e55a8422d754] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:45.300019 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-9e9faae7-4f55-41a2-90fb-b0967236da6f tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:45.300469 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-9e9faae7-4f55-41a2-90fb-b0967236da6f tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:45.301260 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-9e9faae7-4f55-41a2-90fb-b0967236da6f tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:45.301700 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-9e9faae7-4f55-41a2-90fb-b0967236da6f tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:45.394617 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell1:SELECT=100 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:25:45.510022 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-9e9faae7-4f55-41a2-90fb-b0967236da6f tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:25:45.517699 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-9e9faae7-4f55-41a2-90fb-b0967236da6f tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/1b4d9d7f-8b12-4bfa-83a0-e55a8422d754" status: 200 len: 1679 microversion: 2.1 time: 0.229165 Jul 28 18:25:45.518269 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 583/1160] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:25:45 2022] GET /compute/v2.1/servers/1b4d9d7f-8b12-4bfa-83a0-e55a8422d754 => generated 1679 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:25:45.885314 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ea67d937-cc8e-4239-a2bc-c69558759ed4 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:45.886046 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ea67d937-cc8e-4239-a2bc-c69558759ed4 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] [instance: 0308fa68-38a8-43e2-8e64-6de4f4a28f73] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:45.892470 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ea67d937-cc8e-4239-a2bc-c69558759ed4 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:45.892922 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ea67d937-cc8e-4239-a2bc-c69558759ed4 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:45.893733 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ea67d937-cc8e-4239-a2bc-c69558759ed4 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:45.894177 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ea67d937-cc8e-4239-a2bc-c69558759ed4 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:46.029365 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ea67d937-cc8e-4239-a2bc-c69558759ed4 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799a2726f3694d39a70cbdaed5257751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe865ae79cfc41c1a2668f91e8cf0f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:25:46.036808 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ea67d937-cc8e-4239-a2bc-c69558759ed4 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] 10.222.0.86 "GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73" status: 200 len: 1358 microversion: 2.1 time: 0.155717 Jul 28 18:25:46.037403 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 578/1161] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:25:45 2022] GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:25:46.539232 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-4b95d41a-81c7-4eaa-a44d-d0be1d5f7ed5 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:46.539771 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-4b95d41a-81c7-4eaa-a44d-d0be1d5f7ed5 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: 1b4d9d7f-8b12-4bfa-83a0-e55a8422d754] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:46.546252 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-4b95d41a-81c7-4eaa-a44d-d0be1d5f7ed5 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:46.546699 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-4b95d41a-81c7-4eaa-a44d-d0be1d5f7ed5 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:46.547459 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-4b95d41a-81c7-4eaa-a44d-d0be1d5f7ed5 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:46.547893 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-4b95d41a-81c7-4eaa-a44d-d0be1d5f7ed5 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:46.681188 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-4b95d41a-81c7-4eaa-a44d-d0be1d5f7ed5 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:25:46.688648 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-4b95d41a-81c7-4eaa-a44d-d0be1d5f7ed5 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/1b4d9d7f-8b12-4bfa-83a0-e55a8422d754" status: 200 len: 1679 microversion: 2.1 time: 0.153408 Jul 28 18:25:46.689288 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 584/1162] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:25:46 2022] GET /compute/v2.1/servers/1b4d9d7f-8b12-4bfa-83a0-e55a8422d754 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:25:47.058618 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-7b8daa66-a335-4f9d-bd4a-273a78b08911 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:47.059240 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-7b8daa66-a335-4f9d-bd4a-273a78b08911 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] [instance: 0308fa68-38a8-43e2-8e64-6de4f4a28f73] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:47.066996 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7b8daa66-a335-4f9d-bd4a-273a78b08911 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:47.067681 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7b8daa66-a335-4f9d-bd4a-273a78b08911 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:47.068477 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7b8daa66-a335-4f9d-bd4a-273a78b08911 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:47.069058 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7b8daa66-a335-4f9d-bd4a-273a78b08911 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:47.205563 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-7b8daa66-a335-4f9d-bd4a-273a78b08911 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799a2726f3694d39a70cbdaed5257751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe865ae79cfc41c1a2668f91e8cf0f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:25:47.213407 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-7b8daa66-a335-4f9d-bd4a-273a78b08911 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] 10.222.0.86 "GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73" status: 200 len: 1358 microversion: 2.1 time: 0.159302 Jul 28 18:25:47.213962 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 579/1163] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:25:47 2022] GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:25:47.710444 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-9428d507-b4e0-49f7-9632-74e8848d46be tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:47.711065 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-9428d507-b4e0-49f7-9632-74e8848d46be tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: 1b4d9d7f-8b12-4bfa-83a0-e55a8422d754] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:47.718005 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-9428d507-b4e0-49f7-9632-74e8848d46be tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:47.718456 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-9428d507-b4e0-49f7-9632-74e8848d46be tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:47.719222 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-9428d507-b4e0-49f7-9632-74e8848d46be tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:47.719664 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-9428d507-b4e0-49f7-9632-74e8848d46be tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:47.849514 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-9428d507-b4e0-49f7-9632-74e8848d46be tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:25:47.857160 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-9428d507-b4e0-49f7-9632-74e8848d46be tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/1b4d9d7f-8b12-4bfa-83a0-e55a8422d754" status: 200 len: 1679 microversion: 2.1 time: 0.150918 Jul 28 18:25:47.857742 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 585/1164] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:25:47 2022] GET /compute/v2.1/servers/1b4d9d7f-8b12-4bfa-83a0-e55a8422d754 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:25:48.233929 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-bd0bcc76-eea8-4b78-9e55-8b35a534b959 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:48.234540 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-bd0bcc76-eea8-4b78-9e55-8b35a534b959 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] [instance: 0308fa68-38a8-43e2-8e64-6de4f4a28f73] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:48.251468 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bd0bcc76-eea8-4b78-9e55-8b35a534b959 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:48.251468 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bd0bcc76-eea8-4b78-9e55-8b35a534b959 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:48.251468 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bd0bcc76-eea8-4b78-9e55-8b35a534b959 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:48.251468 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bd0bcc76-eea8-4b78-9e55-8b35a534b959 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:48.261240 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:25:48.378895 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-bd0bcc76-eea8-4b78-9e55-8b35a534b959 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799a2726f3694d39a70cbdaed5257751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe865ae79cfc41c1a2668f91e8cf0f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:25:48.386565 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-bd0bcc76-eea8-4b78-9e55-8b35a534b959 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] 10.222.0.86 "GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73" status: 200 len: 1548 microversion: 2.1 time: 0.156945 Jul 28 18:25:48.387133 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 580/1165] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:25:48 2022] GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73 => generated 1548 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:25:48.412085 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-2e3a6679-73cc-4712-a81c-f4eb36c67cc9 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:48.412766 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-2e3a6679-73cc-4712-a81c-f4eb36c67cc9 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] [instance: 0308fa68-38a8-43e2-8e64-6de4f4a28f73] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:48.419966 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2e3a6679-73cc-4712-a81c-f4eb36c67cc9 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:48.420419 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2e3a6679-73cc-4712-a81c-f4eb36c67cc9 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:48.421532 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2e3a6679-73cc-4712-a81c-f4eb36c67cc9 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:48.421972 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2e3a6679-73cc-4712-a81c-f4eb36c67cc9 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:48.554969 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-2e3a6679-73cc-4712-a81c-f4eb36c67cc9 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799a2726f3694d39a70cbdaed5257751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe865ae79cfc41c1a2668f91e8cf0f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:25:48.562614 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-2e3a6679-73cc-4712-a81c-f4eb36c67cc9 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] 10.222.0.86 "GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73" status: 200 len: 1548 microversion: 2.1 time: 0.154506 Jul 28 18:25:48.563194 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 586/1166] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:25:48 2022] GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73 => generated 1548 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:25:48.582822 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-12e30278-5662-42a5-a232-b8510bfeb505 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:48.587697 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-12e30278-5662-42a5-a232-b8510bfeb505 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '799a2726f3694d39a70cbdaed5257751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe865ae79cfc41c1a2668f91e8cf0f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:25:48.588479 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-12e30278-5662-42a5-a232-b8510bfeb505 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Searching by: {'deleted': False, 'project_id': 'fe865ae79cfc41c1a2668f91e8cf0f70'} {{(pid=118453) get_all /opt/stack/nova/nova/compute/api.py:2965}} Jul 28 18:25:48.596943 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-12e30278-5662-42a5-a232-b8510bfeb505 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:48.597428 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-12e30278-5662-42a5-a232-b8510bfeb505 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:48.598236 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-12e30278-5662-42a5-a232-b8510bfeb505 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:48.598706 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-12e30278-5662-42a5-a232-b8510bfeb505 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:48.694923 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.multi_cell_list [None req-12e30278-5662-42a5-a232-b8510bfeb505 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118453) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 18:25:48.789137 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-12e30278-5662-42a5-a232-b8510bfeb505 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] 10.222.0.86 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.210551 Jul 28 18:25:48.789727 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 581/1167] 10.222.0.86 () {58 vars in 1125 bytes} [Thu Jul 28 18:25:48 2022] GET /compute/v2.1/servers => generated 342 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:25:48.800856 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-e54e83b3-da3d-4b12-a3a1-fc330e9515aa tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:48.801600 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-e54e83b3-da3d-4b12-a3a1-fc330e9515aa tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] [instance: 0308fa68-38a8-43e2-8e64-6de4f4a28f73] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:48.808212 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e54e83b3-da3d-4b12-a3a1-fc330e9515aa tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:48.808679 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e54e83b3-da3d-4b12-a3a1-fc330e9515aa tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:48.809500 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e54e83b3-da3d-4b12-a3a1-fc330e9515aa tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:48.809943 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e54e83b3-da3d-4b12-a3a1-fc330e9515aa tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:48.880007 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-bd7bb8b9-98c2-4a4c-a82c-b5f4decb875f tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:48.880793 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-bd7bb8b9-98c2-4a4c-a82c-b5f4decb875f tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: 1b4d9d7f-8b12-4bfa-83a0-e55a8422d754] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:48.887669 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bd7bb8b9-98c2-4a4c-a82c-b5f4decb875f tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:48.888115 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bd7bb8b9-98c2-4a4c-a82c-b5f4decb875f tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:48.889052 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bd7bb8b9-98c2-4a4c-a82c-b5f4decb875f tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:48.889451 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bd7bb8b9-98c2-4a4c-a82c-b5f4decb875f tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:48.976889 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-e54e83b3-da3d-4b12-a3a1-fc330e9515aa tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799a2726f3694d39a70cbdaed5257751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe865ae79cfc41c1a2668f91e8cf0f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:25:48.977114 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-bd7bb8b9-98c2-4a4c-a82c-b5f4decb875f tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:25:48.987757 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-e54e83b3-da3d-4b12-a3a1-fc330e9515aa tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] 10.222.0.86 "GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73" status: 200 len: 1548 microversion: 2.1 time: 0.190481 Jul 28 18:25:48.995472 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-bd7bb8b9-98c2-4a4c-a82c-b5f4decb875f tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/1b4d9d7f-8b12-4bfa-83a0-e55a8422d754" status: 200 len: 1613 microversion: 2.1 time: 0.112921 Jul 28 18:25:48.995472 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 582/1168] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:25:48 2022] GET /compute/v2.1/servers/1b4d9d7f-8b12-4bfa-83a0-e55a8422d754 => generated 1613 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:25:49.009006 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 587/1169] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:25:48 2022] GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73 => generated 1548 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:25:49.143908 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-cb87eb99-5ae5-4bbc-9698-fe3b7a1fbd01 req-d431b5e9-4791-4d52-ac90-cc48d2c3c56d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b4d9d7f-8b12-4bfa-83a0-e55a8422d754", "name": "network-vif-deleted", "tag": "61aa0381-f0f3-4341-9fdf-0aba5beb4f6a"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:25:49.168319 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-cb87eb99-5ae5-4bbc-9698-fe3b7a1fbd01 req-d431b5e9-4791-4d52-ac90-cc48d2c3c56d service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:49.168775 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-cb87eb99-5ae5-4bbc-9698-fe3b7a1fbd01 req-d431b5e9-4791-4d52-ac90-cc48d2c3c56d service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:49.185233 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-cb87eb99-5ae5-4bbc-9698-fe3b7a1fbd01 req-d431b5e9-4791-4d52-ac90-cc48d2c3c56d service nova] Creating event network-vif-deleted:61aa0381-f0f3-4341-9fdf-0aba5beb4f6a for instance 1b4d9d7f-8b12-4bfa-83a0-e55a8422d754 on hv-cinder-84617 Jul 28 18:25:49.190385 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-cb87eb99-5ae5-4bbc-9698-fe3b7a1fbd01 req-d431b5e9-4791-4d52-ac90-cc48d2c3c56d service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050142 Jul 28 18:25:49.191052 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 583/1170] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:25:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:25:50.270238 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-663f46e3-19c2-4159-870f-33245e4731b1 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:50.270857 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-663f46e3-19c2-4159-870f-33245e4731b1 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: 1b4d9d7f-8b12-4bfa-83a0-e55a8422d754] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:50.278102 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-663f46e3-19c2-4159-870f-33245e4731b1 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:50.278102 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-663f46e3-19c2-4159-870f-33245e4731b1 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:50.278427 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-663f46e3-19c2-4159-870f-33245e4731b1 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:50.278688 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-663f46e3-19c2-4159-870f-33245e4731b1 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:50.294046 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.wsgi [None req-663f46e3-19c2-4159-870f-33245e4731b1 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] HTTP exception thrown: Instance 1b4d9d7f-8b12-4bfa-83a0-e55a8422d754 could not be found. Jul 28 18:25:50.295684 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-663f46e3-19c2-4159-870f-33245e4731b1 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Request method failure captured: Jul 28 18:25:50.295684 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: request: GET /compute/v2.1/servers/1b4d9d7f-8b12-4bfa-83a0-e55a8422d754 HTTP/1.1 Jul 28 18:25:50.295684 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Accept: application/json Jul 28 18:25:50.295684 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Accept-Encoding: identity Jul 28 18:25:50.295684 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Connection: close Jul 28 18:25:50.295684 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Content-Length: 0 Jul 28 18:25:50.295684 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Content-Type: application/json Jul 28 18:25:50.295684 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Host: 10.222.0.86 Jul 28 18:25:50.295684 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Openstack-System-Scope: None Jul 28 18:25:50.295684 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: User-Agent: python-urllib3/1.26.10 Jul 28 18:25:50.295684 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Auth-Token: gAAAAABi4tOBTGRF9y9OAlefXy84t2lwOcq7Yp99X6H1ahc3ofs3Ehb5kBGF_9CYSBI80Rx8VFnnn80tQOz0U481VovOm_qAsLcyBFR5gizgfkClDfG1sybWskPJqHUNFOgadZvxg94hprAbcyZjmqgKLYfGkC4nDrgrf7oV07qvZWjTmYx3f6M Jul 28 18:25:50.295684 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Domain-Id: None Jul 28 18:25:50.295684 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Domain-Name: None Jul 28 18:25:50.295684 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Identity-Status: Confirmed Jul 28 18:25:50.295684 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Is-Admin-Project: True Jul 28 18:25:50.295684 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Domain-Id: default Jul 28 18:25:50.295684 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Domain-Name: Default Jul 28 18:25:50.295684 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Id: 104313ce72c94ea68c8cd3ee7f0cab2e Jul 28 18:25:50.295684 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Name: tempest-AttachVolumeNegativeTest-908754065 Jul 28 18:25:50.295684 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Role: member,reader Jul 28 18:25:50.295684 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Roles: member,reader Jul 28 18:25:50.297093 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_104313ce72c94ea68c8cd3ee7f0cab2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/104313ce72c94ea68c8cd3ee7f0cab2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/104313ce72c94ea68c8cd3ee7f0cab2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/104313ce72c94ea68c8cd3ee7f0cab2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}] Jul 28 18:25:50.297093 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant: tempest-AttachVolumeNegativeTest-908754065 Jul 28 18:25:50.297093 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant-Id: 104313ce72c94ea68c8cd3ee7f0cab2e Jul 28 18:25:50.297093 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-908754065 Jul 28 18:25:50.297093 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User: tempest-AttachVolumeNegativeTest-908754065-project Jul 28 18:25:50.297093 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Domain-Id: default Jul 28 18:25:50.297093 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Domain-Name: Default Jul 28 18:25:50.297093 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Id: e2b1f1c4bb2747e0845cdc2991e53b09 Jul 28 18:25:50.297093 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Name: tempest-AttachVolumeNegativeTest-908754065-project Jul 28 18:25:50.297093 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: method: > Jul 28 18:25:50.297093 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: exception: Instance 1b4d9d7f-8b12-4bfa-83a0-e55a8422d754 could not be found. Jul 28 18:25:50.297093 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: action_args: {'id': '1b4d9d7f-8b12-4bfa-83a0-e55a8422d754'} Jul 28 18:25:50.298006 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:25:50.298006 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:25:50.298006 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:25:50.298006 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:25:50.298006 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:25:50.298006 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:25:50.298006 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:25:50.298006 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:25:50.298006 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:25:50.298006 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:25:50.298006 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b4d9d7f-8b12-4bfa-83a0-e55a8422d754 could not be found. Jul 28 18:25:50.298006 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:25:50.298006 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:25:50.298006 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:25:50.298006 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:25:50.298006 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:25:50.298006 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:25:50.298006 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:25:50.298006 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:25:50.298006 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:25:50.299424 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:25:50.299424 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 18:25:50.299424 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 18:25:50.299424 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:25:50.299424 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:25:50.299424 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:25:50.299424 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:25:50.299424 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b4d9d7f-8b12-4bfa-83a0-e55a8422d754 could not be found. Jul 28 18:25:50.299424 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:25:50.299424 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:25:50.299424 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:25:50.299424 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:25:50.299424 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:25:50.299424 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:25:50.299424 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:25:50.299424 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:25:50.299424 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b4d9d7f-8b12-4bfa-83a0-e55a8422d754 could not be found. Jul 28 18:25:50.299424 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:25:50.300583 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-663f46e3-19c2-4159-870f-33245e4731b1 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Returning 404 to user: Instance 1b4d9d7f-8b12-4bfa-83a0-e55a8422d754 could not be found. {{(pid=118454) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:25:50.300583 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-663f46e3-19c2-4159-870f-33245e4731b1 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/1b4d9d7f-8b12-4bfa-83a0-e55a8422d754" status: 404 len: 111 microversion: 2.1 time: 0.286070 Jul 28 18:25:50.300583 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 588/1171] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:25:50 2022] GET /compute/v2.1/servers/1b4d9d7f-8b12-4bfa-83a0-e55a8422d754 => generated 111 bytes in 287 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:25:50.307689 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a6ae81ab-7481-4188-ab9d-89468e3236b1 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '.version_select at 0x7f6fe25c8940>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:50.389267 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-a6ae81ab-7481-4188-ab9d-89468e3236b1 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1954542310" status: 202 len: 0 microversion: 2.1 time: 0.085983 Jul 28 18:25:50.390161 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 584/1172] 10.222.0.86 () {58 vars in 1221 bytes} [Thu Jul 28 18:25:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1954542310 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 18:25:51.021856 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-e7201011-a1a4-443c-b706-74707d8e841d tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d4ab8163-df2b-4910-bf6b-e245f054e3ed"}} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:25:51.024347 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-e7201011-a1a4-443c-b706-74707d8e841d tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] [instance: 0308fa68-38a8-43e2-8e64-6de4f4a28f73] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:51.031438 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e7201011-a1a4-443c-b706-74707d8e841d tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:51.031899 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e7201011-a1a4-443c-b706-74707d8e841d tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:51.032690 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e7201011-a1a4-443c-b706-74707d8e841d tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:51.033165 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e7201011-a1a4-443c-b706-74707d8e841d tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:51.179937 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-1bb167de-8df1-443d-86e8-ac78f9939c4f tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Action: 'create', calling method: .version_select at 0x7f6fe25a6160>, body: {"keypair": {"name": "tempest-keypair-330440370", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGVA0ihM6XurOfSwV9HHL0AugQshkT2U3rFzFhXipWILZikLnZNu1ud+bew3mXi1zYiBwTw73JGKZ8RoYnwqdo+6quyEird7LAxjJfZwGvIyTBI+Pxze5kunEPKbUuj4/A=="}} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:25:51.195543 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.quota [None req-1bb167de-8df1-443d-86e8-ac78f9939c4f tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Getting quotas for project 104313ce72c94ea68c8cd3ee7f0cab2e. Resources: {'key_pairs'} {{(pid=118453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 18:25:51.200045 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.quota [None req-1bb167de-8df1-443d-86e8-ac78f9939c4f tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Getting quotas for user e2b1f1c4bb2747e0845cdc2991e53b09 and project 104313ce72c94ea68c8cd3ee7f0cab2e. Resources: {'key_pairs'} {{(pid=118453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 18:25:51.256401 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-1bb167de-8df1-443d-86e8-ac78f9939c4f tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.080417 Jul 28 18:25:51.257130 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 585/1173] 10.222.0.86 () {60 vars in 1159 bytes} [Thu Jul 28 18:25:51 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 18:25:51.671910 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-e7201011-a1a4-443c-b706-74707d8e841d tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] 10.222.0.86 "POST /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.653816 Jul 28 18:25:51.672467 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 589/1174] 10.222.0.86 () {60 vars in 1323 bytes} [Thu Jul 28 18:25:51 2022] POST /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73/os-volume_attachments => generated 194 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:25:53.769905 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-942d478e-6af4-4104-bb71-e8bae069df79 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-394777173", "imageRef": "61912422-61cd-4ced-a573-85ee305e010f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "44a25a1e-08cb-4158-9e81-b93066923b4d"}], "security_groups": [{"name": "tempest-securitygroup--956094974"}], "key_name": "tempest-keypair-330440370", "user_data": "}} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:25:53.876795 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.network.neutron [None req-942d478e-6af4-4104-bb71-e8bae069df79 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] validate_networks() for [('44a25a1e-08cb-4158-9e81-b93066923b4d', None, None, None, None, None)] {{(pid=118453) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 18:25:54.345586 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-942d478e-6af4-4104-bb71-e8bae069df79 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Flavor limits 0:0:0 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 18:25:54.346011 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-942d478e-6af4-4104-bb71-e8bae069df79 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Image limits 0:0:0 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 18:25:54.346510 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-942d478e-6af4-4104-bb71-e8bae069df79 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Flavor pref 0:0:0 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 18:25:54.346914 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-942d478e-6af4-4104-bb71-e8bae069df79 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Image pref 0:0:0 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 18:25:54.347350 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-942d478e-6af4-4104-bb71-e8bae069df79 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 18:25:54.356672 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-942d478e-6af4-4104-bb71-e8bae069df79 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:54.357165 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-942d478e-6af4-4104-bb71-e8bae069df79 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:54.357964 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-942d478e-6af4-4104-bb71-e8bae069df79 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:54.358403 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-942d478e-6af4-4104-bb71-e8bae069df79 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:54.375143 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.quota [None req-942d478e-6af4-4104-bb71-e8bae069df79 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Getting quotas for project 104313ce72c94ea68c8cd3ee7f0cab2e. Resources: {'cores', 'ram', 'instances'} {{(pid=118453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 18:25:54.379119 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.quota [None req-942d478e-6af4-4104-bb71-e8bae069df79 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Getting quotas for user e2b1f1c4bb2747e0845cdc2991e53b09 and project 104313ce72c94ea68c8cd3ee7f0cab2e. Resources: {'cores', 'ram', 'instances'} {{(pid=118453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 18:25:54.390269 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-942d478e-6af4-4104-bb71-e8bae069df79 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Going to run 1 instances... {{(pid=118453) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 18:25:54.392571 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-942d478e-6af4-4104-bb71-e8bae069df79 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: c06cd5e6-1268-409e-9b59-2f29f39d1404] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='61912422-61cd-4ced-a573-85ee305e010f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 18:25:54.526096 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-942d478e-6af4-4104-bb71-e8bae069df79 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.760523 Jul 28 18:25:54.526749 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 586/1175] 10.222.0.86 () {60 vars in 1147 bytes} [Thu Jul 28 18:25:53 2022] POST /compute/v2.1/servers => generated 401 bytes in 762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 18:25:54.538725 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-9a8b4a2a-e607-4ab9-9fb8-6e5587e9727e tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:54.539457 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-9a8b4a2a-e607-4ab9-9fb8-6e5587e9727e tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: c06cd5e6-1268-409e-9b59-2f29f39d1404] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:54.593960 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-9a8b4a2a-e607-4ab9-9fb8-6e5587e9727e tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:25:54.600744 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-9a8b4a2a-e607-4ab9-9fb8-6e5587e9727e tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/c06cd5e6-1268-409e-9b59-2f29f39d1404" status: 200 len: 1240 microversion: 2.1 time: 0.066930 Jul 28 18:25:54.601387 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 590/1176] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:25:54 2022] GET /compute/v2.1/servers/c06cd5e6-1268-409e-9b59-2f29f39d1404 => generated 1240 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:25:55.621095 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d59bb0fe-55a2-4c20-8e48-5af1d0fdd08b tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:55.622331 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-d59bb0fe-55a2-4c20-8e48-5af1d0fdd08b tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: c06cd5e6-1268-409e-9b59-2f29f39d1404] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:55.628706 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d59bb0fe-55a2-4c20-8e48-5af1d0fdd08b tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:55.629197 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d59bb0fe-55a2-4c20-8e48-5af1d0fdd08b tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:55.629963 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d59bb0fe-55a2-4c20-8e48-5af1d0fdd08b tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:55.630407 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d59bb0fe-55a2-4c20-8e48-5af1d0fdd08b tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:55.690729 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-d59bb0fe-55a2-4c20-8e48-5af1d0fdd08b tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:25:55.698190 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-d59bb0fe-55a2-4c20-8e48-5af1d0fdd08b tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/c06cd5e6-1268-409e-9b59-2f29f39d1404" status: 200 len: 1236 microversion: 2.1 time: 0.081590 Jul 28 18:25:55.698756 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 587/1177] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:25:55 2022] GET /compute/v2.1/servers/c06cd5e6-1268-409e-9b59-2f29f39d1404 => generated 1236 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:25:56.720079 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-8a3c96d0-41d0-4b42-98ab-1523dec6f648 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:56.720672 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-8a3c96d0-41d0-4b42-98ab-1523dec6f648 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: c06cd5e6-1268-409e-9b59-2f29f39d1404] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:56.730193 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-8a3c96d0-41d0-4b42-98ab-1523dec6f648 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:56.730651 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-8a3c96d0-41d0-4b42-98ab-1523dec6f648 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:56.731486 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-8a3c96d0-41d0-4b42-98ab-1523dec6f648 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:56.731930 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-8a3c96d0-41d0-4b42-98ab-1523dec6f648 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:56.793777 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-8a3c96d0-41d0-4b42-98ab-1523dec6f648 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:25:56.801553 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-8a3c96d0-41d0-4b42-98ab-1523dec6f648 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/c06cd5e6-1268-409e-9b59-2f29f39d1404" status: 200 len: 1292 microversion: 2.1 time: 0.085857 Jul 28 18:25:56.804866 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 591/1178] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:25:56 2022] GET /compute/v2.1/servers/c06cd5e6-1268-409e-9b59-2f29f39d1404 => generated 1292 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:25:57.823216 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-6c40a3a8-7bae-47d2-9b10-d485bf5f9375 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:57.824519 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-6c40a3a8-7bae-47d2-9b10-d485bf5f9375 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: c06cd5e6-1268-409e-9b59-2f29f39d1404] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:57.832287 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6c40a3a8-7bae-47d2-9b10-d485bf5f9375 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:57.832752 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6c40a3a8-7bae-47d2-9b10-d485bf5f9375 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:57.833863 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6c40a3a8-7bae-47d2-9b10-d485bf5f9375 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:57.834308 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-6c40a3a8-7bae-47d2-9b10-d485bf5f9375 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:57.979261 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-6c40a3a8-7bae-47d2-9b10-d485bf5f9375 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:25:57.986919 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-6c40a3a8-7bae-47d2-9b10-d485bf5f9375 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/c06cd5e6-1268-409e-9b59-2f29f39d1404" status: 200 len: 1365 microversion: 2.1 time: 0.167641 Jul 28 18:25:57.992954 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 588/1179] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:25:57 2022] GET /compute/v2.1/servers/c06cd5e6-1268-409e-9b59-2f29f39d1404 => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:25:58.750173 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [req-e99e3848-80ce-4274-b31c-6fa39a183a1f req-2daacc28-ab83-4b74-9633-eff6ff097f85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c06cd5e6-1268-409e-9b59-2f29f39d1404", "tag": "df048abb-6acb-481a-a577-df93a01ec1e6"}]} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:25:58.760782 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-e99e3848-80ce-4274-b31c-6fa39a183a1f req-2daacc28-ab83-4b74-9633-eff6ff097f85 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:58.761265 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-e99e3848-80ce-4274-b31c-6fa39a183a1f req-2daacc28-ab83-4b74-9633-eff6ff097f85 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:58.773900 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.compute.server_external_events [req-e99e3848-80ce-4274-b31c-6fa39a183a1f req-2daacc28-ab83-4b74-9633-eff6ff097f85 service nova] Creating event network-changed:df048abb-6acb-481a-a577-df93a01ec1e6 for instance c06cd5e6-1268-409e-9b59-2f29f39d1404 on hv-cinder-84617 Jul 28 18:25:58.779753 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [req-e99e3848-80ce-4274-b31c-6fa39a183a1f req-2daacc28-ab83-4b74-9633-eff6ff097f85 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034270 Jul 28 18:25:58.780353 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 592/1180] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:25:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:25:59.007656 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-edb3d727-3c4a-438b-8c07-a0b3aa57bacf tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:25:59.008180 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-edb3d727-3c4a-438b-8c07-a0b3aa57bacf tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: c06cd5e6-1268-409e-9b59-2f29f39d1404] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:25:59.014843 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-edb3d727-3c4a-438b-8c07-a0b3aa57bacf tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:59.015290 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-edb3d727-3c4a-438b-8c07-a0b3aa57bacf tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:59.016045 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-edb3d727-3c4a-438b-8c07-a0b3aa57bacf tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:25:59.016476 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-edb3d727-3c4a-438b-8c07-a0b3aa57bacf tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:25:59.150484 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-edb3d727-3c4a-438b-8c07-a0b3aa57bacf tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:25:59.159648 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-edb3d727-3c4a-438b-8c07-a0b3aa57bacf tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/c06cd5e6-1268-409e-9b59-2f29f39d1404" status: 200 len: 1365 microversion: 2.1 time: 0.155915 Jul 28 18:25:59.169616 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 589/1181] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:25:59 2022] GET /compute/v2.1/servers/c06cd5e6-1268-409e-9b59-2f29f39d1404 => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:26:00.182102 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-1c779cb4-ba74-4993-930d-df052652d6f6 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:26:00.182811 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-1c779cb4-ba74-4993-930d-df052652d6f6 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: c06cd5e6-1268-409e-9b59-2f29f39d1404] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:26:00.189089 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-1c779cb4-ba74-4993-930d-df052652d6f6 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:26:00.189549 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-1c779cb4-ba74-4993-930d-df052652d6f6 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:26:00.190321 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-1c779cb4-ba74-4993-930d-df052652d6f6 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:26:00.190768 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-1c779cb4-ba74-4993-930d-df052652d6f6 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:26:00.329799 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-1c779cb4-ba74-4993-930d-df052652d6f6 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:26:00.335697 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-509eb41b-18bd-4c8f-823b-25454748d1b4 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:26:00.336357 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-509eb41b-18bd-4c8f-823b-25454748d1b4 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] [instance: 0308fa68-38a8-43e2-8e64-6de4f4a28f73] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:26:00.339770 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-1c779cb4-ba74-4993-930d-df052652d6f6 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/c06cd5e6-1268-409e-9b59-2f29f39d1404" status: 200 len: 1365 microversion: 2.1 time: 0.161168 Jul 28 18:26:00.340430 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 593/1182] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:26:00 2022] GET /compute/v2.1/servers/c06cd5e6-1268-409e-9b59-2f29f39d1404 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:26:00.343129 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-509eb41b-18bd-4c8f-823b-25454748d1b4 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:26:00.343579 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-509eb41b-18bd-4c8f-823b-25454748d1b4 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:26:00.344354 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-509eb41b-18bd-4c8f-823b-25454748d1b4 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:26:00.344794 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-509eb41b-18bd-4c8f-823b-25454748d1b4 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:26:00.482596 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-509eb41b-18bd-4c8f-823b-25454748d1b4 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799a2726f3694d39a70cbdaed5257751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe865ae79cfc41c1a2668f91e8cf0f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:26:00.490675 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-509eb41b-18bd-4c8f-823b-25454748d1b4 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] 10.222.0.86 "GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73" status: 200 len: 1594 microversion: 2.1 time: 0.159059 Jul 28 18:26:00.491300 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 590/1183] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:26:00 2022] GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73 => generated 1594 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:26:01.361901 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-c94ca71d-8034-457a-ac00-dd6f6484b039 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:26:01.362508 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-c94ca71d-8034-457a-ac00-dd6f6484b039 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: c06cd5e6-1268-409e-9b59-2f29f39d1404] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:26:01.369273 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c94ca71d-8034-457a-ac00-dd6f6484b039 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:26:01.369734 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c94ca71d-8034-457a-ac00-dd6f6484b039 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:26:01.370517 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c94ca71d-8034-457a-ac00-dd6f6484b039 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:26:01.370959 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c94ca71d-8034-457a-ac00-dd6f6484b039 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:26:01.630190 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-c94ca71d-8034-457a-ac00-dd6f6484b039 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:26:01.637597 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-c94ca71d-8034-457a-ac00-dd6f6484b039 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/c06cd5e6-1268-409e-9b59-2f29f39d1404" status: 200 len: 1365 microversion: 2.1 time: 0.280550 Jul 28 18:26:01.638157 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 594/1184] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:26:01 2022] GET /compute/v2.1/servers/c06cd5e6-1268-409e-9b59-2f29f39d1404 => generated 1365 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:26:02.659091 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-dea974e7-6d81-4bb8-9aa4-7ca955fcac42 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:26:02.659701 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-dea974e7-6d81-4bb8-9aa4-7ca955fcac42 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: c06cd5e6-1268-409e-9b59-2f29f39d1404] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:26:02.666769 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dea974e7-6d81-4bb8-9aa4-7ca955fcac42 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:26:02.667408 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dea974e7-6d81-4bb8-9aa4-7ca955fcac42 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:26:02.668282 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dea974e7-6d81-4bb8-9aa4-7ca955fcac42 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:26:02.668796 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dea974e7-6d81-4bb8-9aa4-7ca955fcac42 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:26:02.820738 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-dea974e7-6d81-4bb8-9aa4-7ca955fcac42 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:26:02.829397 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-dea974e7-6d81-4bb8-9aa4-7ca955fcac42 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/c06cd5e6-1268-409e-9b59-2f29f39d1404" status: 200 len: 1365 microversion: 2.1 time: 0.173951 Jul 28 18:26:02.830387 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 591/1185] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:26:02 2022] GET /compute/v2.1/servers/c06cd5e6-1268-409e-9b59-2f29f39d1404 => generated 1365 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:26:02.876813 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [req-49297d4f-220e-4de3-9bce-4f9db8ce14e9 req-1669b1f2-d521-4319-83e3-06079a9c8136 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0308fa68-38a8-43e2-8e64-6de4f4a28f73", "tag": "fffe897d-12c2-45ef-b241-0a4c420fa5f6"}]} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:26:02.887425 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-49297d4f-220e-4de3-9bce-4f9db8ce14e9 req-1669b1f2-d521-4319-83e3-06079a9c8136 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:26:02.887867 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-49297d4f-220e-4de3-9bce-4f9db8ce14e9 req-1669b1f2-d521-4319-83e3-06079a9c8136 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:26:02.899888 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.compute.server_external_events [req-49297d4f-220e-4de3-9bce-4f9db8ce14e9 req-1669b1f2-d521-4319-83e3-06079a9c8136 service nova] Creating event network-changed:fffe897d-12c2-45ef-b241-0a4c420fa5f6 for instance 0308fa68-38a8-43e2-8e64-6de4f4a28f73 on hv-cinder-84617 Jul 28 18:26:02.905117 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [req-49297d4f-220e-4de3-9bce-4f9db8ce14e9 req-1669b1f2-d521-4319-83e3-06079a9c8136 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032484 Jul 28 18:26:02.905729 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 595/1186] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:26:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:26:03.856151 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-24618d97-9a7a-4257-8713-43c2af778fab tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:26:03.856852 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-24618d97-9a7a-4257-8713-43c2af778fab tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: c06cd5e6-1268-409e-9b59-2f29f39d1404] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:26:03.864135 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-24618d97-9a7a-4257-8713-43c2af778fab tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:26:03.864683 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-24618d97-9a7a-4257-8713-43c2af778fab tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:26:03.865559 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-24618d97-9a7a-4257-8713-43c2af778fab tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:26:03.866134 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-24618d97-9a7a-4257-8713-43c2af778fab tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:26:04.021916 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-24618d97-9a7a-4257-8713-43c2af778fab tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:26:04.030380 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-24618d97-9a7a-4257-8713-43c2af778fab tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/c06cd5e6-1268-409e-9b59-2f29f39d1404" status: 200 len: 1365 microversion: 2.1 time: 0.178402 Jul 28 18:26:04.030976 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 592/1187] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:26:03 2022] GET /compute/v2.1/servers/c06cd5e6-1268-409e-9b59-2f29f39d1404 => generated 1365 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:26:04.157274 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [req-72ffaa44-81f6-4ddd-a41b-861fd67aa638 req-51f2929a-977d-4e83-ab5a-32b54b488a8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c06cd5e6-1268-409e-9b59-2f29f39d1404", "name": "network-vif-plugged", "status": "completed", "tag": "df048abb-6acb-481a-a577-df93a01ec1e6"}]} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:26:04.169272 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-72ffaa44-81f6-4ddd-a41b-861fd67aa638 req-51f2929a-977d-4e83-ab5a-32b54b488a8c service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:26:04.169749 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-72ffaa44-81f6-4ddd-a41b-861fd67aa638 req-51f2929a-977d-4e83-ab5a-32b54b488a8c service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:26:04.181525 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.compute.server_external_events [req-72ffaa44-81f6-4ddd-a41b-861fd67aa638 req-51f2929a-977d-4e83-ab5a-32b54b488a8c service nova] Creating event network-vif-plugged:df048abb-6acb-481a-a577-df93a01ec1e6 for instance c06cd5e6-1268-409e-9b59-2f29f39d1404 on hv-cinder-84617 Jul 28 18:26:04.186939 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [req-72ffaa44-81f6-4ddd-a41b-861fd67aa638 req-51f2929a-977d-4e83-ab5a-32b54b488a8c service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034885 Jul 28 18:26:04.187964 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 596/1188] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:26:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:26:05.051123 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-1df6672b-6f05-4107-a566-1ca8b9cb9ca9 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:26:05.051744 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-1df6672b-6f05-4107-a566-1ca8b9cb9ca9 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: c06cd5e6-1268-409e-9b59-2f29f39d1404] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:26:05.053727 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell0:SELECT=4 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:26:05.054398 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell0:SELECT=10 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:26:05.059802 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1df6672b-6f05-4107-a566-1ca8b9cb9ca9 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:26:05.060750 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1df6672b-6f05-4107-a566-1ca8b9cb9ca9 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:26:05.061543 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1df6672b-6f05-4107-a566-1ca8b9cb9ca9 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:26:05.061990 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1df6672b-6f05-4107-a566-1ca8b9cb9ca9 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:26:05.225392 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-1df6672b-6f05-4107-a566-1ca8b9cb9ca9 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:26:05.234301 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-1df6672b-6f05-4107-a566-1ca8b9cb9ca9 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/c06cd5e6-1268-409e-9b59-2f29f39d1404" status: 200 len: 1365 microversion: 2.1 time: 0.186965 Jul 28 18:26:05.234888 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 593/1189] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:26:05 2022] GET /compute/v2.1/servers/c06cd5e6-1268-409e-9b59-2f29f39d1404 => generated 1365 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:26:05.557660 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-4b521794-a849-4473-97ec-f523808136d6 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1396800375"}} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:26:05.558302 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-4b521794-a849-4473-97ec-f523808136d6 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] [instance: 0308fa68-38a8-43e2-8e64-6de4f4a28f73] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:26:05.560194 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell0:SELECT=2 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:26:05.565965 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-4b521794-a849-4473-97ec-f523808136d6 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:26:05.566408 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-4b521794-a849-4473-97ec-f523808136d6 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:26:05.567166 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-4b521794-a849-4473-97ec-f523808136d6 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:26:05.567600 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-4b521794-a849-4473-97ec-f523808136d6 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:26:05.701482 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.network.security_group_api [None req-4b521794-a849-4473-97ec-f523808136d6 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Adding security group fdae437d-3bc6-4299-8596-13291fc24e24 to port fffe897d-12c2-45ef-b241-0a4c420fa5f6 Jul 28 18:26:06.117284 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-4b521794-a849-4473-97ec-f523808136d6 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] 10.222.0.86 "POST /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73/action" status: 202 len: 0 microversion: 2.1 time: 0.563946 Jul 28 18:26:06.119076 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 597/1190] 10.222.0.86 () {60 vars in 1278 bytes} [Thu Jul 28 18:26:05 2022] POST /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73/action => generated 0 bytes in 566 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 18:26:06.128090 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f9974281-1f4d-4b33-87b6-3236d1664aff tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:26:06.128611 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f9974281-1f4d-4b33-87b6-3236d1664aff tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] [instance: 0308fa68-38a8-43e2-8e64-6de4f4a28f73] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:26:06.134558 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [req-c9a4c171-18e6-4ba7-b899-ea5271c22e80 req-c3701032-dcfb-4431-8768-10cd354c5d41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0308fa68-38a8-43e2-8e64-6de4f4a28f73", "tag": "fffe897d-12c2-45ef-b241-0a4c420fa5f6"}]} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:26:06.136849 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f9974281-1f4d-4b33-87b6-3236d1664aff tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:26:06.137343 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f9974281-1f4d-4b33-87b6-3236d1664aff tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:26:06.138158 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f9974281-1f4d-4b33-87b6-3236d1664aff tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:26:06.138601 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f9974281-1f4d-4b33-87b6-3236d1664aff tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:26:06.148179 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-c9a4c171-18e6-4ba7-b899-ea5271c22e80 req-c3701032-dcfb-4431-8768-10cd354c5d41 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:26:06.149041 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-c9a4c171-18e6-4ba7-b899-ea5271c22e80 req-c3701032-dcfb-4431-8768-10cd354c5d41 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:26:06.166908 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.compute.server_external_events [req-c9a4c171-18e6-4ba7-b899-ea5271c22e80 req-c3701032-dcfb-4431-8768-10cd354c5d41 service nova] Creating event network-changed:fffe897d-12c2-45ef-b241-0a4c420fa5f6 for instance 0308fa68-38a8-43e2-8e64-6de4f4a28f73 on hv-cinder-84617 Jul 28 18:26:06.174476 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [req-c9a4c171-18e6-4ba7-b899-ea5271c22e80 req-c3701032-dcfb-4431-8768-10cd354c5d41 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045846 Jul 28 18:26:06.175407 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 598/1191] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:26:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:26:06.256516 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-368e04fd-7493-45bb-a154-00aad4724e99 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:26:06.257248 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-368e04fd-7493-45bb-a154-00aad4724e99 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: c06cd5e6-1268-409e-9b59-2f29f39d1404] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:26:06.263973 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-368e04fd-7493-45bb-a154-00aad4724e99 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:26:06.264711 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-368e04fd-7493-45bb-a154-00aad4724e99 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:26:06.265840 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-368e04fd-7493-45bb-a154-00aad4724e99 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:26:06.266445 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-368e04fd-7493-45bb-a154-00aad4724e99 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:26:06.360242 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f9974281-1f4d-4b33-87b6-3236d1664aff tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799a2726f3694d39a70cbdaed5257751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe865ae79cfc41c1a2668f91e8cf0f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:26:06.369422 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f9974281-1f4d-4b33-87b6-3236d1664aff tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] 10.222.0.86 "GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73" status: 200 len: 1760 microversion: 2.1 time: 0.246208 Jul 28 18:26:06.370152 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 594/1192] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:26:06 2022] GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73 => generated 1760 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:26:06.428320 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-368e04fd-7493-45bb-a154-00aad4724e99 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:26:06.436062 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-368e04fd-7493-45bb-a154-00aad4724e99 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/c06cd5e6-1268-409e-9b59-2f29f39d1404" status: 200 len: 1365 microversion: 2.1 time: 0.184012 Jul 28 18:26:06.436777 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 599/1193] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:26:06 2022] GET /compute/v2.1/servers/c06cd5e6-1268-409e-9b59-2f29f39d1404 => generated 1365 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:26:07.456336 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-8b83fccd-a28f-4901-9af6-016c0bf5eecc tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:26:07.456956 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-8b83fccd-a28f-4901-9af6-016c0bf5eecc tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: c06cd5e6-1268-409e-9b59-2f29f39d1404] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:26:07.463814 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8b83fccd-a28f-4901-9af6-016c0bf5eecc tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:26:07.464272 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8b83fccd-a28f-4901-9af6-016c0bf5eecc tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:26:07.465071 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8b83fccd-a28f-4901-9af6-016c0bf5eecc tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:26:07.465521 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8b83fccd-a28f-4901-9af6-016c0bf5eecc tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:26:07.590780 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8b83fccd-a28f-4901-9af6-016c0bf5eecc tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:26:07.598277 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-8b83fccd-a28f-4901-9af6-016c0bf5eecc tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/c06cd5e6-1268-409e-9b59-2f29f39d1404" status: 200 len: 1556 microversion: 2.1 time: 0.145931 Jul 28 18:26:07.598842 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 595/1194] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:26:07 2022] GET /compute/v2.1/servers/c06cd5e6-1268-409e-9b59-2f29f39d1404 => generated 1556 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:26:07.618928 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-8cb6d560-327f-4e74-a189-5cbeb9bd670c tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:26:07.619429 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-8cb6d560-327f-4e74-a189-5cbeb9bd670c tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: c06cd5e6-1268-409e-9b59-2f29f39d1404] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:26:07.626561 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-8cb6d560-327f-4e74-a189-5cbeb9bd670c tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:26:07.627017 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-8cb6d560-327f-4e74-a189-5cbeb9bd670c tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:26:07.627783 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-8cb6d560-327f-4e74-a189-5cbeb9bd670c tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:26:07.628221 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-8cb6d560-327f-4e74-a189-5cbeb9bd670c tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:26:07.708329 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-8cb6d560-327f-4e74-a189-5cbeb9bd670c tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/c06cd5e6-1268-409e-9b59-2f29f39d1404/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093271 Jul 28 18:26:07.709158 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 600/1195] 10.222.0.86 () {58 vars in 1275 bytes} [Thu Jul 28 18:26:07 2022] GET /compute/v2.1/servers/c06cd5e6-1268-409e-9b59-2f29f39d1404/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:26:08.670564 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-323f0196-6e5a-4210-bfb1-19d580d67a27 req-2c192cb5-8b15-4793-b89d-32c4475e1c68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c06cd5e6-1268-409e-9b59-2f29f39d1404", "tag": "df048abb-6acb-481a-a577-df93a01ec1e6"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:26:08.680439 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-323f0196-6e5a-4210-bfb1-19d580d67a27 req-2c192cb5-8b15-4793-b89d-32c4475e1c68 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:26:08.680884 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-323f0196-6e5a-4210-bfb1-19d580d67a27 req-2c192cb5-8b15-4793-b89d-32c4475e1c68 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:26:08.691622 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-323f0196-6e5a-4210-bfb1-19d580d67a27 req-2c192cb5-8b15-4793-b89d-32c4475e1c68 service nova] Creating event network-changed:df048abb-6acb-481a-a577-df93a01ec1e6 for instance c06cd5e6-1268-409e-9b59-2f29f39d1404 on hv-cinder-84617 Jul 28 18:26:08.696728 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-323f0196-6e5a-4210-bfb1-19d580d67a27 req-2c192cb5-8b15-4793-b89d-32c4475e1c68 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030386 Jul 28 18:26:08.697579 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 596/1196] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:26:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:26:44.977408 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_api:SELECT=45 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:26:44.978161 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:26:44.982018 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-2b2e545b-3fa4-4ca0-82b3-789680608650 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:26:44.982550 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-2b2e545b-3fa4-4ca0-82b3-789680608650 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: b7714792-fa29-4af9-b28a-431c9bb2f5b2] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:26:44.982692 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-cf3cbbb1-fb01-4eca-b35c-cce90c0836a1 req-14f4323f-646e-4be5-9af7-3f9b13571b17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7714792-fa29-4af9-b28a-431c9bb2f5b2", "tag": "019e5716-7cc7-4c8a-b0a4-f7f4aab4034a"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:26:44.989478 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2b2e545b-3fa4-4ca0-82b3-789680608650 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:26:44.989859 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2b2e545b-3fa4-4ca0-82b3-789680608650 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:26:44.990076 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:26:44.990657 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2b2e545b-3fa4-4ca0-82b3-789680608650 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:26:44.990788 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=76 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:26:44.991097 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2b2e545b-3fa4-4ca0-82b3-789680608650 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:26:44.995110 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-cf3cbbb1-fb01-4eca-b35c-cce90c0836a1 req-14f4323f-646e-4be5-9af7-3f9b13571b17 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:26:44.995573 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-cf3cbbb1-fb01-4eca-b35c-cce90c0836a1 req-14f4323f-646e-4be5-9af7-3f9b13571b17 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:26:45.006769 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-cf3cbbb1-fb01-4eca-b35c-cce90c0836a1 req-14f4323f-646e-4be5-9af7-3f9b13571b17 service nova] Creating event network-changed:019e5716-7cc7-4c8a-b0a4-f7f4aab4034a for instance b7714792-fa29-4af9-b28a-431c9bb2f5b2 on hv-cinder-84617 Jul 28 18:26:45.012213 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-cf3cbbb1-fb01-4eca-b35c-cce90c0836a1 req-14f4323f-646e-4be5-9af7-3f9b13571b17 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033520 Jul 28 18:26:45.019953 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 597/1197] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:26:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 18:26:45.020473 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-2b2e545b-3fa4-4ca0-82b3-789680608650 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: b7714792-fa29-4af9-b28a-431c9bb2f5b2] Going to try to terminate instance {{(pid=118454) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 18:26:45.415012 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-2b2e545b-3fa4-4ca0-82b3-789680608650 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "DELETE /compute/v2.1/servers/b7714792-fa29-4af9-b28a-431c9bb2f5b2" status: 204 len: 0 microversion: 2.1 time: 0.438846 Jul 28 18:26:45.420129 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 601/1198] 10.222.0.86 () {58 vars in 1239 bytes} [Thu Jul 28 18:26:44 2022] DELETE /compute/v2.1/servers/b7714792-fa29-4af9-b28a-431c9bb2f5b2 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 18:26:45.431810 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-8ae30ba6-ee2a-4e9f-a31d-6fe719123e65 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:26:45.432521 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-8ae30ba6-ee2a-4e9f-a31d-6fe719123e65 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: b7714792-fa29-4af9-b28a-431c9bb2f5b2] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:26:45.440647 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8ae30ba6-ee2a-4e9f-a31d-6fe719123e65 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:26:45.441225 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8ae30ba6-ee2a-4e9f-a31d-6fe719123e65 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:26:45.442009 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8ae30ba6-ee2a-4e9f-a31d-6fe719123e65 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:26:45.442455 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8ae30ba6-ee2a-4e9f-a31d-6fe719123e65 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:26:45.588121 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8ae30ba6-ee2a-4e9f-a31d-6fe719123e65 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:26:45.595806 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-8ae30ba6-ee2a-4e9f-a31d-6fe719123e65 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/b7714792-fa29-4af9-b28a-431c9bb2f5b2" status: 200 len: 1577 microversion: 2.1 time: 0.168212 Jul 28 18:26:45.596472 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 598/1199] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:26:45 2022] GET /compute/v2.1/servers/b7714792-fa29-4af9-b28a-431c9bb2f5b2 => generated 1577 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:26:46.619543 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-70b9c619-8411-4786-9d2e-2c1d537410f5 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:26:46.620246 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-70b9c619-8411-4786-9d2e-2c1d537410f5 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: b7714792-fa29-4af9-b28a-431c9bb2f5b2] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:26:46.627063 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-70b9c619-8411-4786-9d2e-2c1d537410f5 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:26:46.627518 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-70b9c619-8411-4786-9d2e-2c1d537410f5 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:26:46.628283 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-70b9c619-8411-4786-9d2e-2c1d537410f5 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:26:46.628729 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-70b9c619-8411-4786-9d2e-2c1d537410f5 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:26:46.760531 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-70b9c619-8411-4786-9d2e-2c1d537410f5 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:26:46.768123 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-70b9c619-8411-4786-9d2e-2c1d537410f5 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/b7714792-fa29-4af9-b28a-431c9bb2f5b2" status: 200 len: 1577 microversion: 2.1 time: 0.153191 Jul 28 18:26:46.768698 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 602/1200] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:26:46 2022] GET /compute/v2.1/servers/b7714792-fa29-4af9-b28a-431c9bb2f5b2 => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:26:47.789727 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f8b39e6e-abd9-4129-83f1-5d2a7f6fe567 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:26:47.790333 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f8b39e6e-abd9-4129-83f1-5d2a7f6fe567 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: b7714792-fa29-4af9-b28a-431c9bb2f5b2] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:26:47.797317 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f8b39e6e-abd9-4129-83f1-5d2a7f6fe567 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:26:47.797768 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f8b39e6e-abd9-4129-83f1-5d2a7f6fe567 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:26:47.798533 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f8b39e6e-abd9-4129-83f1-5d2a7f6fe567 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:26:47.799007 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f8b39e6e-abd9-4129-83f1-5d2a7f6fe567 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:26:47.940247 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f8b39e6e-abd9-4129-83f1-5d2a7f6fe567 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:26:47.949060 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f8b39e6e-abd9-4129-83f1-5d2a7f6fe567 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/b7714792-fa29-4af9-b28a-431c9bb2f5b2" status: 200 len: 1458 microversion: 2.1 time: 0.163067 Jul 28 18:26:47.949620 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 599/1201] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:26:47 2022] GET /compute/v2.1/servers/b7714792-fa29-4af9-b28a-431c9bb2f5b2 => generated 1458 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:26:47.978162 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [req-73194875-bc4f-4466-8674-3ed65cecab2b req-6e7f8061-6992-44ee-8a54-d44b94cacab0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7714792-fa29-4af9-b28a-431c9bb2f5b2", "name": "network-vif-deleted", "tag": "019e5716-7cc7-4c8a-b0a4-f7f4aab4034a"}]} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:26:47.988080 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-73194875-bc4f-4466-8674-3ed65cecab2b req-6e7f8061-6992-44ee-8a54-d44b94cacab0 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:26:47.988568 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-73194875-bc4f-4466-8674-3ed65cecab2b req-6e7f8061-6992-44ee-8a54-d44b94cacab0 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:26:47.999820 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.compute.server_external_events [req-73194875-bc4f-4466-8674-3ed65cecab2b req-6e7f8061-6992-44ee-8a54-d44b94cacab0 service nova] Creating event network-vif-deleted:019e5716-7cc7-4c8a-b0a4-f7f4aab4034a for instance b7714792-fa29-4af9-b28a-431c9bb2f5b2 on hv-cinder-84617 Jul 28 18:26:48.005389 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [req-73194875-bc4f-4466-8674-3ed65cecab2b req-6e7f8061-6992-44ee-8a54-d44b94cacab0 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030828 Jul 28 18:26:48.005994 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 603/1202] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:26:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:26:48.972005 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-05ddd5d7-a06a-4f64-bf59-bf99fd547a93 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:26:48.973227 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-05ddd5d7-a06a-4f64-bf59-bf99fd547a93 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: b7714792-fa29-4af9-b28a-431c9bb2f5b2] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:26:48.979835 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-05ddd5d7-a06a-4f64-bf59-bf99fd547a93 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:26:48.980277 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-05ddd5d7-a06a-4f64-bf59-bf99fd547a93 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:26:48.981067 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-05ddd5d7-a06a-4f64-bf59-bf99fd547a93 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:26:48.981506 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-05ddd5d7-a06a-4f64-bf59-bf99fd547a93 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:26:49.012106 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-05ddd5d7-a06a-4f64-bf59-bf99fd547a93 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:26:49.012560 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-05ddd5d7-a06a-4f64-bf59-bf99fd547a93 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:26:49.013038 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.objects.instance [None req-05ddd5d7-a06a-4f64-bf59-bf99fd547a93 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lazy-loading 'fault' on Instance uuid b7714792-fa29-4af9-b28a-431c9bb2f5b2 {{(pid=118453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:26:49.059096 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-05ddd5d7-a06a-4f64-bf59-bf99fd547a93 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:26:49.064788 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-05ddd5d7-a06a-4f64-bf59-bf99fd547a93 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/b7714792-fa29-4af9-b28a-431c9bb2f5b2" status: 200 len: 1230 microversion: 2.1 time: 0.096694 Jul 28 18:26:49.065384 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 600/1203] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:26:48 2022] GET /compute/v2.1/servers/b7714792-fa29-4af9-b28a-431c9bb2f5b2 => generated 1230 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:26:50.087854 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-d8bd7a14-4985-4267-ac63-cdc71cde5f8c tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:26:50.088580 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-d8bd7a14-4985-4267-ac63-cdc71cde5f8c tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: b7714792-fa29-4af9-b28a-431c9bb2f5b2] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:26:50.094759 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d8bd7a14-4985-4267-ac63-cdc71cde5f8c tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:26:50.095200 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d8bd7a14-4985-4267-ac63-cdc71cde5f8c tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:26:50.095949 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d8bd7a14-4985-4267-ac63-cdc71cde5f8c tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:26:50.096409 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d8bd7a14-4985-4267-ac63-cdc71cde5f8c tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:26:50.109326 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.wsgi [None req-d8bd7a14-4985-4267-ac63-cdc71cde5f8c tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] HTTP exception thrown: Instance b7714792-fa29-4af9-b28a-431c9bb2f5b2 could not be found. Jul 28 18:26:50.110903 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-d8bd7a14-4985-4267-ac63-cdc71cde5f8c tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Request method failure captured: Jul 28 18:26:50.110903 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: request: GET /compute/v2.1/servers/b7714792-fa29-4af9-b28a-431c9bb2f5b2 HTTP/1.1 Jul 28 18:26:50.110903 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Accept: application/json Jul 28 18:26:50.110903 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Accept-Encoding: identity Jul 28 18:26:50.110903 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Connection: close Jul 28 18:26:50.110903 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Content-Length: 0 Jul 28 18:26:50.110903 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Content-Type: application/json Jul 28 18:26:50.110903 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Host: 10.222.0.86 Jul 28 18:26:50.110903 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Openstack-System-Scope: None Jul 28 18:26:50.110903 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: User-Agent: python-urllib3/1.26.10 Jul 28 18:26:50.110903 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Auth-Token: gAAAAABi4tKADOyNlfFwikUXw-WoMifZZxpuvbn7JEeADT74_QvGJt-yMXp_KjT-wzXh_xsMzVwyamDANEYjyiJOBNQ4yK1rS_2YPrT65yaFJQ7qKd6YMsNdRwJF1cZSND6GICiEmHRtehHzhyztHZ7oy5jLyY2bzXs6UaP_cXT2a3nqBTni7Ec Jul 28 18:26:50.110903 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Domain-Id: None Jul 28 18:26:50.110903 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Domain-Name: None Jul 28 18:26:50.110903 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Identity-Status: Confirmed Jul 28 18:26:50.110903 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Is-Admin-Project: True Jul 28 18:26:50.110903 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Domain-Id: default Jul 28 18:26:50.110903 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Domain-Name: Default Jul 28 18:26:50.110903 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Id: 308e6cf086ae4cdea9c591ed2811c976 Jul 28 18:26:50.110903 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Name: tempest-TestVolumeBootPattern-2035805745 Jul 28 18:26:50.110903 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Role: member,reader Jul 28 18:26:50.110903 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Roles: member,reader Jul 28 18:26:50.112583 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_308e6cf086ae4cdea9c591ed2811c976"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/308e6cf086ae4cdea9c591ed2811c976"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/308e6cf086ae4cdea9c591ed2811c976"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/308e6cf086ae4cdea9c591ed2811c976"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}] Jul 28 18:26:50.112583 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant: tempest-TestVolumeBootPattern-2035805745 Jul 28 18:26:50.112583 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant-Id: 308e6cf086ae4cdea9c591ed2811c976 Jul 28 18:26:50.112583 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant-Name: tempest-TestVolumeBootPattern-2035805745 Jul 28 18:26:50.112583 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User: tempest-TestVolumeBootPattern-2035805745-project Jul 28 18:26:50.112583 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Domain-Id: default Jul 28 18:26:50.112583 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Domain-Name: Default Jul 28 18:26:50.112583 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Id: 30f0002d2a5a4950b2f1aa771f33bbc1 Jul 28 18:26:50.112583 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Name: tempest-TestVolumeBootPattern-2035805745-project Jul 28 18:26:50.112583 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: method: > Jul 28 18:26:50.112583 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: exception: Instance b7714792-fa29-4af9-b28a-431c9bb2f5b2 could not be found. Jul 28 18:26:50.112583 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: action_args: {'id': 'b7714792-fa29-4af9-b28a-431c9bb2f5b2'} Jul 28 18:26:50.113606 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:26:50.113606 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:26:50.113606 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:26:50.113606 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:26:50.113606 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:26:50.113606 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:26:50.113606 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:26:50.113606 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:26:50.113606 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:26:50.113606 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:26:50.113606 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7714792-fa29-4af9-b28a-431c9bb2f5b2 could not be found. Jul 28 18:26:50.113606 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:26:50.113606 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:26:50.113606 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:26:50.113606 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:26:50.113606 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:26:50.113606 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:26:50.113606 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:26:50.113606 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:26:50.113606 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:26:50.115245 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:26:50.115245 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 18:26:50.115245 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 18:26:50.115245 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:26:50.115245 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:26:50.115245 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:26:50.115245 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:26:50.115245 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7714792-fa29-4af9-b28a-431c9bb2f5b2 could not be found. Jul 28 18:26:50.115245 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:26:50.115245 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:26:50.115245 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:26:50.115245 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:26:50.115245 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:26:50.115245 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:26:50.115245 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:26:50.115245 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:26:50.115245 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7714792-fa29-4af9-b28a-431c9bb2f5b2 could not be found. Jul 28 18:26:50.115245 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:26:50.116695 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-d8bd7a14-4985-4267-ac63-cdc71cde5f8c tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Returning 404 to user: Instance b7714792-fa29-4af9-b28a-431c9bb2f5b2 could not be found. {{(pid=118454) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:26:50.116695 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-d8bd7a14-4985-4267-ac63-cdc71cde5f8c tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/b7714792-fa29-4af9-b28a-431c9bb2f5b2" status: 404 len: 111 microversion: 2.1 time: 0.029959 Jul 28 18:26:50.116695 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 604/1204] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:26:50 2022] GET /compute/v2.1/servers/b7714792-fa29-4af9-b28a-431c9bb2f5b2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:26:53.644410 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3c6013ad-c109-4a74-8f46-2717d5654c5b tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:26:53.644947 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3c6013ad-c109-4a74-8f46-2717d5654c5b tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: cc02a9d1-d99e-4119-b12f-63effaab3d40] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:26:53.646508 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [req-77c84980-5eaf-4ffd-a27b-7775daf1f3d7 req-614c842d-3a30-40a0-b5f8-a95c5dc74b68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc02a9d1-d99e-4119-b12f-63effaab3d40", "tag": "2bf36b8c-9461-4402-a7fa-dd60e55d9326"}]} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:26:53.651684 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3c6013ad-c109-4a74-8f46-2717d5654c5b tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:26:53.652152 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3c6013ad-c109-4a74-8f46-2717d5654c5b tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:26:53.653014 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3c6013ad-c109-4a74-8f46-2717d5654c5b tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:26:53.653467 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3c6013ad-c109-4a74-8f46-2717d5654c5b tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:26:53.658316 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-77c84980-5eaf-4ffd-a27b-7775daf1f3d7 req-614c842d-3a30-40a0-b5f8-a95c5dc74b68 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:26:53.658852 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-77c84980-5eaf-4ffd-a27b-7775daf1f3d7 req-614c842d-3a30-40a0-b5f8-a95c5dc74b68 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:26:53.670670 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.compute.server_external_events [req-77c84980-5eaf-4ffd-a27b-7775daf1f3d7 req-614c842d-3a30-40a0-b5f8-a95c5dc74b68 service nova] Creating event network-changed:2bf36b8c-9461-4402-a7fa-dd60e55d9326 for instance cc02a9d1-d99e-4119-b12f-63effaab3d40 on hv-cinder-84617 Jul 28 18:26:53.676903 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [req-77c84980-5eaf-4ffd-a27b-7775daf1f3d7 req-614c842d-3a30-40a0-b5f8-a95c5dc74b68 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033349 Jul 28 18:26:53.678149 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 605/1205] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:26:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:26:53.679897 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3c6013ad-c109-4a74-8f46-2717d5654c5b tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: cc02a9d1-d99e-4119-b12f-63effaab3d40] Going to try to terminate instance {{(pid=118453) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 18:26:53.939388 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-3c6013ad-c109-4a74-8f46-2717d5654c5b tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "DELETE /compute/v2.1/servers/cc02a9d1-d99e-4119-b12f-63effaab3d40" status: 204 len: 0 microversion: 2.1 time: 0.298652 Jul 28 18:26:53.940403 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 601/1206] 10.222.0.86 () {58 vars in 1239 bytes} [Thu Jul 28 18:26:53 2022] DELETE /compute/v2.1/servers/cc02a9d1-d99e-4119-b12f-63effaab3d40 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 18:26:53.949388 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-64f28808-2c85-4cb5-99bd-7a3d87711e8f tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:26:53.950252 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-64f28808-2c85-4cb5-99bd-7a3d87711e8f tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: cc02a9d1-d99e-4119-b12f-63effaab3d40] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:26:53.957187 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-64f28808-2c85-4cb5-99bd-7a3d87711e8f tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:26:53.957899 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-64f28808-2c85-4cb5-99bd-7a3d87711e8f tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:26:53.958684 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-64f28808-2c85-4cb5-99bd-7a3d87711e8f tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:26:53.959230 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-64f28808-2c85-4cb5-99bd-7a3d87711e8f tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:26:54.093777 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-64f28808-2c85-4cb5-99bd-7a3d87711e8f tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:26:54.101898 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-64f28808-2c85-4cb5-99bd-7a3d87711e8f tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/cc02a9d1-d99e-4119-b12f-63effaab3d40" status: 200 len: 1577 microversion: 2.1 time: 0.157061 Jul 28 18:26:54.102562 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 606/1207] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:26:53 2022] GET /compute/v2.1/servers/cc02a9d1-d99e-4119-b12f-63effaab3d40 => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:26:55.124764 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-8d56148d-972f-43cc-9374-ff0d1d3cf119 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:26:55.125521 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-8d56148d-972f-43cc-9374-ff0d1d3cf119 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: cc02a9d1-d99e-4119-b12f-63effaab3d40] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:26:55.132081 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8d56148d-972f-43cc-9374-ff0d1d3cf119 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:26:55.132534 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8d56148d-972f-43cc-9374-ff0d1d3cf119 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:26:55.133346 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8d56148d-972f-43cc-9374-ff0d1d3cf119 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:26:55.133792 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8d56148d-972f-43cc-9374-ff0d1d3cf119 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:26:55.268005 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8d56148d-972f-43cc-9374-ff0d1d3cf119 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:26:55.276169 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-8d56148d-972f-43cc-9374-ff0d1d3cf119 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/cc02a9d1-d99e-4119-b12f-63effaab3d40" status: 200 len: 1458 microversion: 2.1 time: 0.155697 Jul 28 18:26:55.276734 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 602/1208] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:26:55 2022] GET /compute/v2.1/servers/cc02a9d1-d99e-4119-b12f-63effaab3d40 => generated 1458 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:26:55.694799 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [req-2f5d7e26-0ace-4fa9-942c-e0aaba195681 req-c4553af4-655d-4fe0-909e-53a5e7dc00c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc02a9d1-d99e-4119-b12f-63effaab3d40", "name": "network-vif-deleted", "tag": "2bf36b8c-9461-4402-a7fa-dd60e55d9326"}]} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:26:55.705063 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-2f5d7e26-0ace-4fa9-942c-e0aaba195681 req-c4553af4-655d-4fe0-909e-53a5e7dc00c7 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:26:55.705517 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-2f5d7e26-0ace-4fa9-942c-e0aaba195681 req-c4553af4-655d-4fe0-909e-53a5e7dc00c7 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:26:55.717192 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.compute.server_external_events [req-2f5d7e26-0ace-4fa9-942c-e0aaba195681 req-c4553af4-655d-4fe0-909e-53a5e7dc00c7 service nova] Creating event network-vif-deleted:2bf36b8c-9461-4402-a7fa-dd60e55d9326 for instance cc02a9d1-d99e-4119-b12f-63effaab3d40 on hv-cinder-84617 Jul 28 18:26:55.722223 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [req-2f5d7e26-0ace-4fa9-942c-e0aaba195681 req-c4553af4-655d-4fe0-909e-53a5e7dc00c7 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031777 Jul 28 18:26:55.723142 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 607/1209] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:26:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 18:26:56.296756 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b324e297-839f-4a84-8a41-31e308ab44dc tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:26:56.297997 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-b324e297-839f-4a84-8a41-31e308ab44dc tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: cc02a9d1-d99e-4119-b12f-63effaab3d40] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:26:56.305532 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b324e297-839f-4a84-8a41-31e308ab44dc tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:26:56.305986 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b324e297-839f-4a84-8a41-31e308ab44dc tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:26:56.306755 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b324e297-839f-4a84-8a41-31e308ab44dc tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:26:56.307198 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b324e297-839f-4a84-8a41-31e308ab44dc tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:26:56.338416 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b324e297-839f-4a84-8a41-31e308ab44dc tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:26:56.338866 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-b324e297-839f-4a84-8a41-31e308ab44dc tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:26:56.339309 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.objects.instance [None req-b324e297-839f-4a84-8a41-31e308ab44dc tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lazy-loading 'fault' on Instance uuid cc02a9d1-d99e-4119-b12f-63effaab3d40 {{(pid=118453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:26:56.383199 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-b324e297-839f-4a84-8a41-31e308ab44dc tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f0002d2a5a4950b2f1aa771f33bbc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '308e6cf086ae4cdea9c591ed2811c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:26:56.390852 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b324e297-839f-4a84-8a41-31e308ab44dc tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/cc02a9d1-d99e-4119-b12f-63effaab3d40" status: 200 len: 1229 microversion: 2.1 time: 0.098025 Jul 28 18:26:56.391433 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 603/1210] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:26:56 2022] GET /compute/v2.1/servers/cc02a9d1-d99e-4119-b12f-63effaab3d40 => generated 1229 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:26:57.412762 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-aa129b0c-a899-4941-9ba2-7461074729aa tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:26:57.413514 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-aa129b0c-a899-4941-9ba2-7461074729aa tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: cc02a9d1-d99e-4119-b12f-63effaab3d40] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:26:57.420527 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-aa129b0c-a899-4941-9ba2-7461074729aa tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:26:57.421097 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-aa129b0c-a899-4941-9ba2-7461074729aa tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:26:57.421756 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-aa129b0c-a899-4941-9ba2-7461074729aa tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:26:57.422311 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-aa129b0c-a899-4941-9ba2-7461074729aa tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:26:57.437556 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.wsgi [None req-aa129b0c-a899-4941-9ba2-7461074729aa tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] HTTP exception thrown: Instance cc02a9d1-d99e-4119-b12f-63effaab3d40 could not be found. Jul 28 18:26:57.439269 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-aa129b0c-a899-4941-9ba2-7461074729aa tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Request method failure captured: Jul 28 18:26:57.439269 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: request: GET /compute/v2.1/servers/cc02a9d1-d99e-4119-b12f-63effaab3d40 HTTP/1.1 Jul 28 18:26:57.439269 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Accept: application/json Jul 28 18:26:57.439269 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Accept-Encoding: identity Jul 28 18:26:57.439269 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Connection: close Jul 28 18:26:57.439269 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Content-Length: 0 Jul 28 18:26:57.439269 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Content-Type: application/json Jul 28 18:26:57.439269 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Host: 10.222.0.86 Jul 28 18:26:57.439269 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Openstack-System-Scope: None Jul 28 18:26:57.439269 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: User-Agent: python-urllib3/1.26.10 Jul 28 18:26:57.439269 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Auth-Token: gAAAAABi4tKADOyNlfFwikUXw-WoMifZZxpuvbn7JEeADT74_QvGJt-yMXp_KjT-wzXh_xsMzVwyamDANEYjyiJOBNQ4yK1rS_2YPrT65yaFJQ7qKd6YMsNdRwJF1cZSND6GICiEmHRtehHzhyztHZ7oy5jLyY2bzXs6UaP_cXT2a3nqBTni7Ec Jul 28 18:26:57.439269 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Domain-Id: None Jul 28 18:26:57.439269 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Domain-Name: None Jul 28 18:26:57.439269 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Identity-Status: Confirmed Jul 28 18:26:57.439269 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Is-Admin-Project: True Jul 28 18:26:57.439269 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Domain-Id: default Jul 28 18:26:57.439269 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Domain-Name: Default Jul 28 18:26:57.439269 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Id: 308e6cf086ae4cdea9c591ed2811c976 Jul 28 18:26:57.439269 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Name: tempest-TestVolumeBootPattern-2035805745 Jul 28 18:26:57.439269 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Role: member,reader Jul 28 18:26:57.439269 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Roles: member,reader Jul 28 18:26:57.440990 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_308e6cf086ae4cdea9c591ed2811c976"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/308e6cf086ae4cdea9c591ed2811c976"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/308e6cf086ae4cdea9c591ed2811c976"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/308e6cf086ae4cdea9c591ed2811c976"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}] Jul 28 18:26:57.440990 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant: tempest-TestVolumeBootPattern-2035805745 Jul 28 18:26:57.440990 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant-Id: 308e6cf086ae4cdea9c591ed2811c976 Jul 28 18:26:57.440990 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant-Name: tempest-TestVolumeBootPattern-2035805745 Jul 28 18:26:57.440990 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User: tempest-TestVolumeBootPattern-2035805745-project Jul 28 18:26:57.440990 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Domain-Id: default Jul 28 18:26:57.440990 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Domain-Name: Default Jul 28 18:26:57.440990 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Id: 30f0002d2a5a4950b2f1aa771f33bbc1 Jul 28 18:26:57.440990 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Name: tempest-TestVolumeBootPattern-2035805745-project Jul 28 18:26:57.440990 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: method: > Jul 28 18:26:57.440990 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: exception: Instance cc02a9d1-d99e-4119-b12f-63effaab3d40 could not be found. Jul 28 18:26:57.440990 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: action_args: {'id': 'cc02a9d1-d99e-4119-b12f-63effaab3d40'} Jul 28 18:26:57.444617 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:26:57.444617 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:26:57.444617 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:26:57.444617 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:26:57.444617 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:26:57.444617 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:26:57.444617 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:26:57.444617 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:26:57.444617 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:26:57.444617 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:26:57.444617 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc02a9d1-d99e-4119-b12f-63effaab3d40 could not be found. Jul 28 18:26:57.444617 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:26:57.444617 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:26:57.444617 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:26:57.444617 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:26:57.444617 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:26:57.444617 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:26:57.444617 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:26:57.444617 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:26:57.444617 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:26:57.446259 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:26:57.446259 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 18:26:57.446259 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 18:26:57.446259 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:26:57.446259 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:26:57.446259 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:26:57.446259 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:26:57.446259 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc02a9d1-d99e-4119-b12f-63effaab3d40 could not be found. Jul 28 18:26:57.446259 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:26:57.446259 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:26:57.446259 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:26:57.446259 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:26:57.446259 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:26:57.446259 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:26:57.446259 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:26:57.446259 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:26:57.446259 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc02a9d1-d99e-4119-b12f-63effaab3d40 could not be found. Jul 28 18:26:57.446259 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:26:57.448176 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-aa129b0c-a899-4941-9ba2-7461074729aa tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Returning 404 to user: Instance cc02a9d1-d99e-4119-b12f-63effaab3d40 could not be found. {{(pid=118454) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:26:57.448176 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-aa129b0c-a899-4941-9ba2-7461074729aa tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/cc02a9d1-d99e-4119-b12f-63effaab3d40" status: 404 len: 111 microversion: 2.1 time: 0.032612 Jul 28 18:26:57.448176 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 608/1211] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:26:57 2022] GET /compute/v2.1/servers/cc02a9d1-d99e-4119-b12f-63effaab3d40 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:26:57.998307 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5a7cc7ce-93d1-4e5b-b54b-9dd1a9153d54 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:26:57.998881 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-5a7cc7ce-93d1-4e5b-b54b-9dd1a9153d54 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: 60bf3b10-9241-4fb1-9543-46147477634d] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:26:58.005488 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5a7cc7ce-93d1-4e5b-b54b-9dd1a9153d54 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:26:58.005944 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5a7cc7ce-93d1-4e5b-b54b-9dd1a9153d54 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:26:58.006715 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5a7cc7ce-93d1-4e5b-b54b-9dd1a9153d54 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:26:58.007157 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5a7cc7ce-93d1-4e5b-b54b-9dd1a9153d54 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:26:58.020105 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.wsgi [None req-5a7cc7ce-93d1-4e5b-b54b-9dd1a9153d54 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] HTTP exception thrown: Instance 60bf3b10-9241-4fb1-9543-46147477634d could not be found. Jul 28 18:26:58.022271 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5a7cc7ce-93d1-4e5b-b54b-9dd1a9153d54 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Request method failure captured: Jul 28 18:26:58.022271 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: request: DELETE /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d HTTP/1.1 Jul 28 18:26:58.022271 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Accept: application/json Jul 28 18:26:58.022271 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Accept-Encoding: identity Jul 28 18:26:58.022271 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Connection: close Jul 28 18:26:58.022271 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Content-Length: 0 Jul 28 18:26:58.022271 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Content-Type: application/json Jul 28 18:26:58.022271 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Host: 10.222.0.86 Jul 28 18:26:58.022271 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Openstack-System-Scope: None Jul 28 18:26:58.022271 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: User-Agent: python-urllib3/1.26.10 Jul 28 18:26:58.022271 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Auth-Token: gAAAAABi4tKADOyNlfFwikUXw-WoMifZZxpuvbn7JEeADT74_QvGJt-yMXp_KjT-wzXh_xsMzVwyamDANEYjyiJOBNQ4yK1rS_2YPrT65yaFJQ7qKd6YMsNdRwJF1cZSND6GICiEmHRtehHzhyztHZ7oy5jLyY2bzXs6UaP_cXT2a3nqBTni7Ec Jul 28 18:26:58.022271 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Domain-Id: None Jul 28 18:26:58.022271 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Domain-Name: None Jul 28 18:26:58.022271 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Identity-Status: Confirmed Jul 28 18:26:58.022271 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Is-Admin-Project: True Jul 28 18:26:58.022271 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Id: default Jul 28 18:26:58.022271 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Name: Default Jul 28 18:26:58.022271 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Id: 308e6cf086ae4cdea9c591ed2811c976 Jul 28 18:26:58.022271 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Name: tempest-TestVolumeBootPattern-2035805745 Jul 28 18:26:58.022271 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Role: member,reader Jul 28 18:26:58.022271 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Roles: member,reader Jul 28 18:26:58.024054 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_308e6cf086ae4cdea9c591ed2811c976"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/308e6cf086ae4cdea9c591ed2811c976"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/308e6cf086ae4cdea9c591ed2811c976"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/308e6cf086ae4cdea9c591ed2811c976"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}] Jul 28 18:26:58.024054 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant: tempest-TestVolumeBootPattern-2035805745 Jul 28 18:26:58.024054 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant-Id: 308e6cf086ae4cdea9c591ed2811c976 Jul 28 18:26:58.024054 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant-Name: tempest-TestVolumeBootPattern-2035805745 Jul 28 18:26:58.024054 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User: tempest-TestVolumeBootPattern-2035805745-project Jul 28 18:26:58.024054 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Id: default Jul 28 18:26:58.024054 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Name: Default Jul 28 18:26:58.024054 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Id: 30f0002d2a5a4950b2f1aa771f33bbc1 Jul 28 18:26:58.024054 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Name: tempest-TestVolumeBootPattern-2035805745-project Jul 28 18:26:58.024054 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: method: > Jul 28 18:26:58.024054 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: exception: Instance 60bf3b10-9241-4fb1-9543-46147477634d could not be found. Jul 28 18:26:58.024054 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: action_args: {'id': '60bf3b10-9241-4fb1-9543-46147477634d'} Jul 28 18:26:58.025035 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:26:58.025035 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:26:58.025035 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:26:58.025035 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:26:58.025035 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:26:58.025035 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:26:58.025035 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:26:58.025035 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:26:58.025035 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:26:58.025035 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:26:58.025035 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60bf3b10-9241-4fb1-9543-46147477634d could not be found. Jul 28 18:26:58.025035 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:26:58.025035 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:26:58.025035 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:26:58.025035 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:26:58.025035 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:26:58.025035 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:26:58.025035 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:26:58.025035 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:26:58.025035 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:26:58.026773 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:26:58.026773 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 18:26:58.026773 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 18:26:58.026773 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 18:26:58.026773 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 18:26:58.026773 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:26:58.026773 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:26:58.026773 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:26:58.026773 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:26:58.026773 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60bf3b10-9241-4fb1-9543-46147477634d could not be found. Jul 28 18:26:58.026773 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:26:58.026773 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:26:58.026773 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:26:58.026773 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:26:58.026773 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:26:58.026773 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:26:58.026773 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:26:58.026773 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:26:58.026773 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60bf3b10-9241-4fb1-9543-46147477634d could not be found. Jul 28 18:26:58.026773 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:26:58.028326 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5a7cc7ce-93d1-4e5b-b54b-9dd1a9153d54 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Returning 404 to user: Instance 60bf3b10-9241-4fb1-9543-46147477634d could not be found. {{(pid=118453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:26:58.028326 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-5a7cc7ce-93d1-4e5b-b54b-9dd1a9153d54 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "DELETE /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d" status: 404 len: 111 microversion: 2.1 time: 0.029194 Jul 28 18:26:58.028326 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 604/1212] 10.222.0.86 () {58 vars in 1239 bytes} [Thu Jul 28 18:26:57 2022] DELETE /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:26:58.032421 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-b5058497-c157-4127-a83d-16f6edd4b6bf tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:26:58.033062 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-b5058497-c157-4127-a83d-16f6edd4b6bf tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] [instance: 60bf3b10-9241-4fb1-9543-46147477634d] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:26:58.039600 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b5058497-c157-4127-a83d-16f6edd4b6bf tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:26:58.040044 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b5058497-c157-4127-a83d-16f6edd4b6bf tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:26:58.040807 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b5058497-c157-4127-a83d-16f6edd4b6bf tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:26:58.041270 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b5058497-c157-4127-a83d-16f6edd4b6bf tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:26:58.054348 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.wsgi [None req-b5058497-c157-4127-a83d-16f6edd4b6bf tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] HTTP exception thrown: Instance 60bf3b10-9241-4fb1-9543-46147477634d could not be found. Jul 28 18:26:58.055843 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-b5058497-c157-4127-a83d-16f6edd4b6bf tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Request method failure captured: Jul 28 18:26:58.055843 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: request: GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d HTTP/1.1 Jul 28 18:26:58.055843 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Accept: application/json Jul 28 18:26:58.055843 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Accept-Encoding: identity Jul 28 18:26:58.055843 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Connection: close Jul 28 18:26:58.055843 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Content-Length: 0 Jul 28 18:26:58.055843 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Content-Type: application/json Jul 28 18:26:58.055843 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Host: 10.222.0.86 Jul 28 18:26:58.055843 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Openstack-System-Scope: None Jul 28 18:26:58.055843 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: User-Agent: python-urllib3/1.26.10 Jul 28 18:26:58.055843 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Auth-Token: gAAAAABi4tKADOyNlfFwikUXw-WoMifZZxpuvbn7JEeADT74_QvGJt-yMXp_KjT-wzXh_xsMzVwyamDANEYjyiJOBNQ4yK1rS_2YPrT65yaFJQ7qKd6YMsNdRwJF1cZSND6GICiEmHRtehHzhyztHZ7oy5jLyY2bzXs6UaP_cXT2a3nqBTni7Ec Jul 28 18:26:58.055843 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Domain-Id: None Jul 28 18:26:58.055843 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Domain-Name: None Jul 28 18:26:58.055843 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Identity-Status: Confirmed Jul 28 18:26:58.055843 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Is-Admin-Project: True Jul 28 18:26:58.055843 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Domain-Id: default Jul 28 18:26:58.055843 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Domain-Name: Default Jul 28 18:26:58.055843 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Id: 308e6cf086ae4cdea9c591ed2811c976 Jul 28 18:26:58.055843 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Name: tempest-TestVolumeBootPattern-2035805745 Jul 28 18:26:58.055843 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Role: member,reader Jul 28 18:26:58.055843 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Roles: member,reader Jul 28 18:26:58.057570 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_308e6cf086ae4cdea9c591ed2811c976"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/308e6cf086ae4cdea9c591ed2811c976"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/308e6cf086ae4cdea9c591ed2811c976"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/308e6cf086ae4cdea9c591ed2811c976"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}] Jul 28 18:26:58.057570 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant: tempest-TestVolumeBootPattern-2035805745 Jul 28 18:26:58.057570 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant-Id: 308e6cf086ae4cdea9c591ed2811c976 Jul 28 18:26:58.057570 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant-Name: tempest-TestVolumeBootPattern-2035805745 Jul 28 18:26:58.057570 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User: tempest-TestVolumeBootPattern-2035805745-project Jul 28 18:26:58.057570 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Domain-Id: default Jul 28 18:26:58.057570 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Domain-Name: Default Jul 28 18:26:58.057570 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Id: 30f0002d2a5a4950b2f1aa771f33bbc1 Jul 28 18:26:58.057570 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Name: tempest-TestVolumeBootPattern-2035805745-project Jul 28 18:26:58.057570 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: method: > Jul 28 18:26:58.057570 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: exception: Instance 60bf3b10-9241-4fb1-9543-46147477634d could not be found. Jul 28 18:26:58.057570 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: action_args: {'id': '60bf3b10-9241-4fb1-9543-46147477634d'} Jul 28 18:26:58.058566 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:26:58.058566 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:26:58.058566 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:26:58.058566 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:26:58.058566 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:26:58.058566 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:26:58.058566 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:26:58.058566 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:26:58.058566 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:26:58.058566 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:26:58.058566 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60bf3b10-9241-4fb1-9543-46147477634d could not be found. Jul 28 18:26:58.058566 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:26:58.058566 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:26:58.058566 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:26:58.058566 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:26:58.058566 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:26:58.058566 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:26:58.058566 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:26:58.058566 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:26:58.058566 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:26:58.060131 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:26:58.060131 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 18:26:58.060131 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 18:26:58.060131 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:26:58.060131 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:26:58.060131 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:26:58.060131 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:26:58.060131 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60bf3b10-9241-4fb1-9543-46147477634d could not be found. Jul 28 18:26:58.060131 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:26:58.060131 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:26:58.060131 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:26:58.060131 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:26:58.060131 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:26:58.060131 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:26:58.060131 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:26:58.060131 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:26:58.060131 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60bf3b10-9241-4fb1-9543-46147477634d could not be found. Jul 28 18:26:58.060131 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:26:58.061978 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-b5058497-c157-4127-a83d-16f6edd4b6bf tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Returning 404 to user: Instance 60bf3b10-9241-4fb1-9543-46147477634d could not be found. {{(pid=118454) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:26:58.061978 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-b5058497-c157-4127-a83d-16f6edd4b6bf tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d" status: 404 len: 111 microversion: 2.1 time: 0.028805 Jul 28 18:26:58.061978 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 609/1213] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:26:58 2022] GET /compute/v2.1/servers/60bf3b10-9241-4fb1-9543-46147477634d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:26:59.582958 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-022554a2-6149-4684-b63b-ca39359f8060 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] Calling method '.version_select at 0x7f6fe25c8700>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:26:59.666082 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-022554a2-6149-4684-b63b-ca39359f8060 tempest-TestVolumeBootPattern-2035805745 tempest-TestVolumeBootPattern-2035805745-project] 10.222.0.86 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-554928045" status: 202 len: 0 microversion: 2.1 time: 0.087066 Jul 28 18:26:59.666610 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 605/1214] 10.222.0.86 () {58 vars in 1260 bytes} [Thu Jul 28 18:26:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-554928045 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 18:27:03.979287 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-e9bcc654-9951-4de4-bd5b-0befde5fb6d7 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:27:03.981625 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-e9bcc654-9951-4de4-bd5b-0befde5fb6d7 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] [instance: 0308fa68-38a8-43e2-8e64-6de4f4a28f73] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:27:03.989524 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e9bcc654-9951-4de4-bd5b-0befde5fb6d7 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:27:03.990506 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e9bcc654-9951-4de4-bd5b-0befde5fb6d7 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:27:03.991291 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e9bcc654-9951-4de4-bd5b-0befde5fb6d7 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:27:03.991906 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e9bcc654-9951-4de4-bd5b-0befde5fb6d7 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:27:04.234191 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-e9bcc654-9951-4de4-bd5b-0befde5fb6d7 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] 10.222.0.86 "POST /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73/action" status: 202 len: 0 microversion: 2.1 time: 0.258577 Jul 28 18:27:04.234844 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 610/1215] 10.222.0.86 () {60 vars in 1278 bytes} [Thu Jul 28 18:27:03 2022] POST /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 18:27:04.246645 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-03cd0bd0-0557-4396-98f5-3a5e2eecff45 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:27:04.249945 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-03cd0bd0-0557-4396-98f5-3a5e2eecff45 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] [instance: 0308fa68-38a8-43e2-8e64-6de4f4a28f73] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:27:04.257130 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-03cd0bd0-0557-4396-98f5-3a5e2eecff45 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:27:04.257615 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-03cd0bd0-0557-4396-98f5-3a5e2eecff45 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:27:04.259144 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-03cd0bd0-0557-4396-98f5-3a5e2eecff45 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:27:04.259913 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-03cd0bd0-0557-4396-98f5-3a5e2eecff45 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:27:04.507503 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-03cd0bd0-0557-4396-98f5-3a5e2eecff45 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799a2726f3694d39a70cbdaed5257751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe865ae79cfc41c1a2668f91e8cf0f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:27:04.515973 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-03cd0bd0-0557-4396-98f5-3a5e2eecff45 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] 10.222.0.86 "GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73" status: 200 len: 1752 microversion: 2.1 time: 0.276460 Jul 28 18:27:04.516553 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 606/1216] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:27:04 2022] GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73 => generated 1752 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:27:05.540497 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-89cecb49-01ea-4980-a271-d7529fd32670 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:27:05.541404 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-89cecb49-01ea-4980-a271-d7529fd32670 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] [instance: 0308fa68-38a8-43e2-8e64-6de4f4a28f73] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:27:05.548275 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-89cecb49-01ea-4980-a271-d7529fd32670 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:27:05.548717 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-89cecb49-01ea-4980-a271-d7529fd32670 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:27:05.549625 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-89cecb49-01ea-4980-a271-d7529fd32670 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:27:05.550154 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-89cecb49-01ea-4980-a271-d7529fd32670 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:27:05.806960 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-89cecb49-01ea-4980-a271-d7529fd32670 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799a2726f3694d39a70cbdaed5257751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe865ae79cfc41c1a2668f91e8cf0f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:27:05.813793 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-89cecb49-01ea-4980-a271-d7529fd32670 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] 10.222.0.86 "GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73" status: 200 len: 1757 microversion: 2.1 time: 0.277630 Jul 28 18:27:05.814548 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 611/1217] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:27:05 2022] GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73 => generated 1757 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:27:06.836318 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3ceb9b05-c494-40d5-b331-4411dcd6976a tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:27:06.837920 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3ceb9b05-c494-40d5-b331-4411dcd6976a tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] [instance: 0308fa68-38a8-43e2-8e64-6de4f4a28f73] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:27:06.847832 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3ceb9b05-c494-40d5-b331-4411dcd6976a tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:27:06.849159 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3ceb9b05-c494-40d5-b331-4411dcd6976a tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:27:06.849281 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3ceb9b05-c494-40d5-b331-4411dcd6976a tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:27:06.849711 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3ceb9b05-c494-40d5-b331-4411dcd6976a tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:27:07.008012 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-3ceb9b05-c494-40d5-b331-4411dcd6976a tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799a2726f3694d39a70cbdaed5257751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe865ae79cfc41c1a2668f91e8cf0f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:27:07.013775 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-3ceb9b05-c494-40d5-b331-4411dcd6976a tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] 10.222.0.86 "GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73" status: 200 len: 1757 microversion: 2.1 time: 0.181576 Jul 28 18:27:07.014359 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 607/1218] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:27:06 2022] GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73 => generated 1757 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:27:08.035165 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-986ade96-b4c7-4977-b4b5-d786c01c5314 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:27:08.035780 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-986ade96-b4c7-4977-b4b5-d786c01c5314 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] [instance: 0308fa68-38a8-43e2-8e64-6de4f4a28f73] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:27:08.042350 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-986ade96-b4c7-4977-b4b5-d786c01c5314 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:27:08.042805 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-986ade96-b4c7-4977-b4b5-d786c01c5314 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:27:08.043577 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-986ade96-b4c7-4977-b4b5-d786c01c5314 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:27:08.044018 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-986ade96-b4c7-4977-b4b5-d786c01c5314 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:27:08.195118 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-986ade96-b4c7-4977-b4b5-d786c01c5314 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799a2726f3694d39a70cbdaed5257751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe865ae79cfc41c1a2668f91e8cf0f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:27:08.204391 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-986ade96-b4c7-4977-b4b5-d786c01c5314 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] 10.222.0.86 "GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73" status: 200 len: 1757 microversion: 2.1 time: 0.172761 Jul 28 18:27:08.205576 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 612/1219] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:27:08 2022] GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73 => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:27:09.228925 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-7ab4959d-c663-4679-b049-815ec99e3cb2 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:27:09.229491 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-7ab4959d-c663-4679-b049-815ec99e3cb2 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] [instance: 0308fa68-38a8-43e2-8e64-6de4f4a28f73] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:27:09.236128 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7ab4959d-c663-4679-b049-815ec99e3cb2 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:27:09.236578 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7ab4959d-c663-4679-b049-815ec99e3cb2 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:27:09.237433 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7ab4959d-c663-4679-b049-815ec99e3cb2 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:27:09.237872 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7ab4959d-c663-4679-b049-815ec99e3cb2 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:27:09.378927 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-7ab4959d-c663-4679-b049-815ec99e3cb2 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799a2726f3694d39a70cbdaed5257751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe865ae79cfc41c1a2668f91e8cf0f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:27:09.386831 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-7ab4959d-c663-4679-b049-815ec99e3cb2 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] 10.222.0.86 "GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73" status: 200 len: 1757 microversion: 2.1 time: 0.162006 Jul 28 18:27:09.387398 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 608/1220] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:27:09 2022] GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73 => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:27:10.407724 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-f2460065-e0df-45ec-a85a-ef588be91f9e tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:27:10.408379 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-f2460065-e0df-45ec-a85a-ef588be91f9e tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] [instance: 0308fa68-38a8-43e2-8e64-6de4f4a28f73] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:27:10.415654 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f2460065-e0df-45ec-a85a-ef588be91f9e tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:27:10.416173 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f2460065-e0df-45ec-a85a-ef588be91f9e tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:27:10.417009 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f2460065-e0df-45ec-a85a-ef588be91f9e tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:27:10.417451 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-f2460065-e0df-45ec-a85a-ef588be91f9e tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:27:10.559167 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-f2460065-e0df-45ec-a85a-ef588be91f9e tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799a2726f3694d39a70cbdaed5257751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe865ae79cfc41c1a2668f91e8cf0f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:27:10.567313 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-f2460065-e0df-45ec-a85a-ef588be91f9e tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] 10.222.0.86 "GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73" status: 200 len: 1757 microversion: 2.1 time: 0.163476 Jul 28 18:27:10.567877 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 613/1221] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:27:10 2022] GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:27:11.589091 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-fdb9f4e5-aae9-413e-b2fd-895aab845b3e tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:27:11.589711 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-fdb9f4e5-aae9-413e-b2fd-895aab845b3e tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] [instance: 0308fa68-38a8-43e2-8e64-6de4f4a28f73] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:27:11.595844 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fdb9f4e5-aae9-413e-b2fd-895aab845b3e tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:27:11.596297 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fdb9f4e5-aae9-413e-b2fd-895aab845b3e tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:27:11.597093 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fdb9f4e5-aae9-413e-b2fd-895aab845b3e tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:27:11.597540 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fdb9f4e5-aae9-413e-b2fd-895aab845b3e tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:27:11.738954 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-fdb9f4e5-aae9-413e-b2fd-895aab845b3e tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799a2726f3694d39a70cbdaed5257751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe865ae79cfc41c1a2668f91e8cf0f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:27:11.747581 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-fdb9f4e5-aae9-413e-b2fd-895aab845b3e tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] 10.222.0.86 "GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73" status: 200 len: 1757 microversion: 2.1 time: 0.162576 Jul 28 18:27:11.748155 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 609/1222] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:27:11 2022] GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73 => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:27:12.769024 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-2b53e918-e570-40d4-9397-28ce2d555b13 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:27:12.769549 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-2b53e918-e570-40d4-9397-28ce2d555b13 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] [instance: 0308fa68-38a8-43e2-8e64-6de4f4a28f73] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:27:12.776685 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2b53e918-e570-40d4-9397-28ce2d555b13 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:27:12.777183 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2b53e918-e570-40d4-9397-28ce2d555b13 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:27:12.777954 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2b53e918-e570-40d4-9397-28ce2d555b13 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:27:12.778397 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-2b53e918-e570-40d4-9397-28ce2d555b13 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:27:12.920604 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-2b53e918-e570-40d4-9397-28ce2d555b13 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799a2726f3694d39a70cbdaed5257751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe865ae79cfc41c1a2668f91e8cf0f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:27:12.929287 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-2b53e918-e570-40d4-9397-28ce2d555b13 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] 10.222.0.86 "GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73" status: 200 len: 1757 microversion: 2.1 time: 0.164305 Jul 28 18:27:12.929848 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 614/1223] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:27:12 2022] GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:27:13.950915 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f37f1661-33fe-41c4-acad-aa997340a60c tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:27:13.951563 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f37f1661-33fe-41c4-acad-aa997340a60c tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] [instance: 0308fa68-38a8-43e2-8e64-6de4f4a28f73] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:27:13.958300 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f37f1661-33fe-41c4-acad-aa997340a60c tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:27:13.958745 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f37f1661-33fe-41c4-acad-aa997340a60c tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:27:13.959498 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f37f1661-33fe-41c4-acad-aa997340a60c tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:27:13.959931 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f37f1661-33fe-41c4-acad-aa997340a60c tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:27:14.102701 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-f37f1661-33fe-41c4-acad-aa997340a60c tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799a2726f3694d39a70cbdaed5257751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe865ae79cfc41c1a2668f91e8cf0f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:27:14.110691 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f37f1661-33fe-41c4-acad-aa997340a60c tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] 10.222.0.86 "GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73" status: 200 len: 1757 microversion: 2.1 time: 0.163798 Jul 28 18:27:14.111271 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 610/1224] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:27:13 2022] GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:27:15.133387 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-1cb866d8-c9cf-41ac-9633-7bddc2170280 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:27:15.134011 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-1cb866d8-c9cf-41ac-9633-7bddc2170280 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] [instance: 0308fa68-38a8-43e2-8e64-6de4f4a28f73] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:27:15.136404 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:27:15.141170 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-1cb866d8-c9cf-41ac-9633-7bddc2170280 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:27:15.141621 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-1cb866d8-c9cf-41ac-9633-7bddc2170280 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:27:15.142399 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-1cb866d8-c9cf-41ac-9633-7bddc2170280 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:27:15.144853 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-1cb866d8-c9cf-41ac-9633-7bddc2170280 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:27:15.284144 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-1cb866d8-c9cf-41ac-9633-7bddc2170280 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799a2726f3694d39a70cbdaed5257751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe865ae79cfc41c1a2668f91e8cf0f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:27:15.292050 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-1cb866d8-c9cf-41ac-9633-7bddc2170280 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] 10.222.0.86 "GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73" status: 200 len: 1757 microversion: 2.1 time: 0.163199 Jul 28 18:27:15.292612 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 615/1225] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:27:15 2022] GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73 => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:27:16.313969 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ddc511aa-1f94-4a98-a630-1abb21fc397a tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:27:16.314607 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ddc511aa-1f94-4a98-a630-1abb21fc397a tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] [instance: 0308fa68-38a8-43e2-8e64-6de4f4a28f73] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:27:16.321666 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ddc511aa-1f94-4a98-a630-1abb21fc397a tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:27:16.322108 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ddc511aa-1f94-4a98-a630-1abb21fc397a tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:27:16.322861 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ddc511aa-1f94-4a98-a630-1abb21fc397a tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:27:16.323292 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ddc511aa-1f94-4a98-a630-1abb21fc397a tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:27:16.326038 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:27:16.469888 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ddc511aa-1f94-4a98-a630-1abb21fc397a tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799a2726f3694d39a70cbdaed5257751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe865ae79cfc41c1a2668f91e8cf0f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:27:16.477725 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ddc511aa-1f94-4a98-a630-1abb21fc397a tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] 10.222.0.86 "GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73" status: 200 len: 1757 microversion: 2.1 time: 0.167660 Jul 28 18:27:16.478290 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 611/1226] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:27:16 2022] GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:27:17.499454 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-ea951ab6-5f6d-4ad9-b201-8d839973dd5a tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:27:17.500130 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-ea951ab6-5f6d-4ad9-b201-8d839973dd5a tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] [instance: 0308fa68-38a8-43e2-8e64-6de4f4a28f73] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:27:17.522526 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ea951ab6-5f6d-4ad9-b201-8d839973dd5a tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:27:17.523006 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ea951ab6-5f6d-4ad9-b201-8d839973dd5a tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:27:17.523789 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ea951ab6-5f6d-4ad9-b201-8d839973dd5a tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:27:17.524234 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ea951ab6-5f6d-4ad9-b201-8d839973dd5a tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:27:17.528212 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:27:17.677947 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-ea951ab6-5f6d-4ad9-b201-8d839973dd5a tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799a2726f3694d39a70cbdaed5257751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe865ae79cfc41c1a2668f91e8cf0f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:27:17.685841 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-ea951ab6-5f6d-4ad9-b201-8d839973dd5a tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] 10.222.0.86 "GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73" status: 200 len: 1757 microversion: 2.1 time: 0.190322 Jul 28 18:27:17.686405 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 616/1227] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:27:17 2022] GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73 => generated 1757 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:27:18.708369 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-37f366ad-6c70-4bde-972d-616f95d5efb1 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:27:18.708917 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-37f366ad-6c70-4bde-972d-616f95d5efb1 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] [instance: 0308fa68-38a8-43e2-8e64-6de4f4a28f73] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:27:18.711391 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:27:18.716481 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-37f366ad-6c70-4bde-972d-616f95d5efb1 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:27:18.716931 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-37f366ad-6c70-4bde-972d-616f95d5efb1 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:27:18.717732 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-37f366ad-6c70-4bde-972d-616f95d5efb1 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:27:18.718174 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-37f366ad-6c70-4bde-972d-616f95d5efb1 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:27:18.859699 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-37f366ad-6c70-4bde-972d-616f95d5efb1 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799a2726f3694d39a70cbdaed5257751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe865ae79cfc41c1a2668f91e8cf0f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:27:18.867598 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-37f366ad-6c70-4bde-972d-616f95d5efb1 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] 10.222.0.86 "GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73" status: 200 len: 1757 microversion: 2.1 time: 0.163826 Jul 28 18:27:18.868157 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 612/1228] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:27:18 2022] GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:27:19.889418 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-cc81976e-bc1f-40a6-a5a1-83aa321873d5 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:27:19.890050 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-cc81976e-bc1f-40a6-a5a1-83aa321873d5 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] [instance: 0308fa68-38a8-43e2-8e64-6de4f4a28f73] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:27:19.897382 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-cc81976e-bc1f-40a6-a5a1-83aa321873d5 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:27:19.899933 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-cc81976e-bc1f-40a6-a5a1-83aa321873d5 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:27:19.899933 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-cc81976e-bc1f-40a6-a5a1-83aa321873d5 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:27:19.899933 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-cc81976e-bc1f-40a6-a5a1-83aa321873d5 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:27:20.045495 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-cc81976e-bc1f-40a6-a5a1-83aa321873d5 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799a2726f3694d39a70cbdaed5257751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe865ae79cfc41c1a2668f91e8cf0f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:27:20.053390 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-cc81976e-bc1f-40a6-a5a1-83aa321873d5 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] 10.222.0.86 "GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73" status: 200 len: 1757 microversion: 2.1 time: 0.168547 Jul 28 18:27:20.053962 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 617/1229] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:27:19 2022] GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:27:21.074657 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-4906896c-f2c0-4879-941e-d5fc5e63191c tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:27:21.075274 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-4906896c-f2c0-4879-941e-d5fc5e63191c tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] [instance: 0308fa68-38a8-43e2-8e64-6de4f4a28f73] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:27:21.084048 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4906896c-f2c0-4879-941e-d5fc5e63191c tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:27:21.084507 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4906896c-f2c0-4879-941e-d5fc5e63191c tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:27:21.085307 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4906896c-f2c0-4879-941e-d5fc5e63191c tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:27:21.085753 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4906896c-f2c0-4879-941e-d5fc5e63191c tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:27:21.225397 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-4906896c-f2c0-4879-941e-d5fc5e63191c tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799a2726f3694d39a70cbdaed5257751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe865ae79cfc41c1a2668f91e8cf0f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:27:21.233424 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-4906896c-f2c0-4879-941e-d5fc5e63191c tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] 10.222.0.86 "GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73" status: 200 len: 1757 microversion: 2.1 time: 0.162801 Jul 28 18:27:21.233981 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 613/1230] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:27:21 2022] GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73 => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:27:22.255808 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-366af46b-7e9f-4160-bc52-027a866e3439 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:27:22.256436 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-366af46b-7e9f-4160-bc52-027a866e3439 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] [instance: 0308fa68-38a8-43e2-8e64-6de4f4a28f73] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:27:22.262892 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-366af46b-7e9f-4160-bc52-027a866e3439 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:27:22.263332 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-366af46b-7e9f-4160-bc52-027a866e3439 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:27:22.264095 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-366af46b-7e9f-4160-bc52-027a866e3439 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:27:22.264530 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-366af46b-7e9f-4160-bc52-027a866e3439 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:27:22.407123 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-366af46b-7e9f-4160-bc52-027a866e3439 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799a2726f3694d39a70cbdaed5257751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe865ae79cfc41c1a2668f91e8cf0f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:27:22.415268 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-366af46b-7e9f-4160-bc52-027a866e3439 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] 10.222.0.86 "GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73" status: 200 len: 1760 microversion: 2.1 time: 0.163750 Jul 28 18:27:22.415852 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 618/1231] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:27:22 2022] GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73 => generated 1760 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:27:35.482171 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-35302e59-524f-4d33-bf8d-dcdf4b59dabe tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:27:35.482813 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-35302e59-524f-4d33-bf8d-dcdf4b59dabe tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: c06cd5e6-1268-409e-9b59-2f29f39d1404] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:27:35.485125 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=3 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:27:35.485784 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=17 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:27:35.491020 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-35302e59-524f-4d33-bf8d-dcdf4b59dabe tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:27:35.491478 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-35302e59-524f-4d33-bf8d-dcdf4b59dabe tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:27:35.492252 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-35302e59-524f-4d33-bf8d-dcdf4b59dabe tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:27:35.492692 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-35302e59-524f-4d33-bf8d-dcdf4b59dabe tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:27:35.516122 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-35302e59-524f-4d33-bf8d-dcdf4b59dabe tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/c06cd5e6-1268-409e-9b59-2f29f39d1404/ips" status: 200 len: 150 microversion: 2.1 time: 0.037803 Jul 28 18:27:35.516711 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 614/1232] 10.222.0.86 () {58 vars in 1248 bytes} [Thu Jul 28 18:27:35 2022] GET /compute/v2.1/servers/c06cd5e6-1268-409e-9b59-2f29f39d1404/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:27:37.057975 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-18051779-0693-437c-a931-2f9dd44883f8 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8ed514c8-e8b7-4207-aa09-817aa0cf2e66"}} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:27:37.060296 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-18051779-0693-437c-a931-2f9dd44883f8 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: c06cd5e6-1268-409e-9b59-2f29f39d1404] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:27:37.062346 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_api:SELECT=7 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:27:37.062990 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell1:SELECT=17 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:27:37.067667 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-18051779-0693-437c-a931-2f9dd44883f8 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:27:37.068111 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-18051779-0693-437c-a931-2f9dd44883f8 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:27:37.069517 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-18051779-0693-437c-a931-2f9dd44883f8 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:27:37.069952 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-18051779-0693-437c-a931-2f9dd44883f8 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:27:38.141792 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-18051779-0693-437c-a931-2f9dd44883f8 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "POST /compute/v2.1/servers/c06cd5e6-1268-409e-9b59-2f29f39d1404/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.087745 Jul 28 18:27:38.142469 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 619/1233] 10.222.0.86 () {60 vars in 1323 bytes} [Thu Jul 28 18:27:37 2022] POST /compute/v2.1/servers/c06cd5e6-1268-409e-9b59-2f29f39d1404/os-volume_attachments => generated 194 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:27:41.816059 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 18:27:41.816733 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Thu Jul 28 18:27:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 18:27:46.716419 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-7c845f17-ced5-447a-86ff-4a1c21f18598 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8ed514c8-e8b7-4207-aa09-817aa0cf2e66"}} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:27:46.718853 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-7c845f17-ced5-447a-86ff-4a1c21f18598 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: c06cd5e6-1268-409e-9b59-2f29f39d1404] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:27:46.725412 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7c845f17-ced5-447a-86ff-4a1c21f18598 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:27:46.725858 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7c845f17-ced5-447a-86ff-4a1c21f18598 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:27:46.726606 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7c845f17-ced5-447a-86ff-4a1c21f18598 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:27:46.727040 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7c845f17-ced5-447a-86ff-4a1c21f18598 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:27:46.860158 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.wsgi [None req-7c845f17-ced5-447a-86ff-4a1c21f18598 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] HTTP exception thrown: Invalid volume: volume 8ed514c8-e8b7-4207-aa09-817aa0cf2e66 is already attached to instances: c06cd5e6-1268-409e-9b59-2f29f39d1404 Jul 28 18:27:46.862138 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-7c845f17-ced5-447a-86ff-4a1c21f18598 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Request method failure captured: Jul 28 18:27:46.862138 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: request: POST /compute/v2.1/servers/c06cd5e6-1268-409e-9b59-2f29f39d1404/os-volume_attachments HTTP/1.1 Jul 28 18:27:46.862138 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Accept: application/json Jul 28 18:27:46.862138 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Accept-Encoding: identity Jul 28 18:27:46.862138 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Connection: close Jul 28 18:27:46.862138 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Content-Length: 74 Jul 28 18:27:46.862138 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Content-Type: application/json Jul 28 18:27:46.862138 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Host: 10.222.0.86 Jul 28 18:27:46.862138 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Openstack-System-Scope: None Jul 28 18:27:46.862138 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: User-Agent: python-urllib3/1.26.10 Jul 28 18:27:46.862138 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Auth-Token: gAAAAABi4tOBTGRF9y9OAlefXy84t2lwOcq7Yp99X6H1ahc3ofs3Ehb5kBGF_9CYSBI80Rx8VFnnn80tQOz0U481VovOm_qAsLcyBFR5gizgfkClDfG1sybWskPJqHUNFOgadZvxg94hprAbcyZjmqgKLYfGkC4nDrgrf7oV07qvZWjTmYx3f6M Jul 28 18:27:46.862138 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Domain-Id: None Jul 28 18:27:46.862138 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Domain-Name: None Jul 28 18:27:46.862138 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Identity-Status: Confirmed Jul 28 18:27:46.862138 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Is-Admin-Project: True Jul 28 18:27:46.862138 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Id: default Jul 28 18:27:46.862138 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Name: Default Jul 28 18:27:46.862138 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Id: 104313ce72c94ea68c8cd3ee7f0cab2e Jul 28 18:27:46.862138 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Name: tempest-AttachVolumeNegativeTest-908754065 Jul 28 18:27:46.862138 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Role: member,reader Jul 28 18:27:46.862138 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Roles: member,reader Jul 28 18:27:46.863647 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_104313ce72c94ea68c8cd3ee7f0cab2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/104313ce72c94ea68c8cd3ee7f0cab2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/104313ce72c94ea68c8cd3ee7f0cab2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/104313ce72c94ea68c8cd3ee7f0cab2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}] Jul 28 18:27:46.863647 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant: tempest-AttachVolumeNegativeTest-908754065 Jul 28 18:27:46.863647 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant-Id: 104313ce72c94ea68c8cd3ee7f0cab2e Jul 28 18:27:46.863647 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-908754065 Jul 28 18:27:46.863647 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User: tempest-AttachVolumeNegativeTest-908754065-project Jul 28 18:27:46.863647 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Id: default Jul 28 18:27:46.863647 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Name: Default Jul 28 18:27:46.863647 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Id: e2b1f1c4bb2747e0845cdc2991e53b09 Jul 28 18:27:46.863647 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Name: tempest-AttachVolumeNegativeTest-908754065-project Jul 28 18:27:46.863647 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Jul 28 18:27:46.863647 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: {"volumeAttachment": {"volumeId": "8ed514c8-e8b7-4207-aa09-817aa0cf2e66"}} Jul 28 18:27:46.863647 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: method: > Jul 28 18:27:46.864558 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: exception: Invalid volume: volume 8ed514c8-e8b7-4207-aa09-817aa0cf2e66 is already attached to instances: c06cd5e6-1268-409e-9b59-2f29f39d1404 Jul 28 18:27:46.864558 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: action_args: {'server_id': 'c06cd5e6-1268-409e-9b59-2f29f39d1404', 'body': {'volumeAttachment': {'volumeId': '8ed514c8-e8b7-4207-aa09-817aa0cf2e66'}}} Jul 28 18:27:46.864558 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:27:46.864558 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:27:46.864558 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 28 18:27:46.864558 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 28 18:27:46.864558 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 18:27:46.864558 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 18:27:46.864558 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 28 18:27:46.864558 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 18:27:46.864558 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5067, in attach_volume Jul 28 18:27:46.864558 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 28 18:27:46.864558 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4907, in _check_volume_already_attached Jul 28 18:27:46.864558 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 28 18:27:46.864558 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 8ed514c8-e8b7-4207-aa09-817aa0cf2e66 is already attached to instances: c06cd5e6-1268-409e-9b59-2f29f39d1404 Jul 28 18:27:46.864558 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:27:46.864558 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:27:46.864558 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:27:46.864558 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:27:46.867988 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:27:46.867988 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:27:46.867988 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:27:46.867988 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:27:46.867988 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:27:46.867988 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:27:46.867988 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 18:27:46.867988 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 18:27:46.867988 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 18:27:46.867988 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 18:27:46.867988 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 18:27:46.867988 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 18:27:46.867988 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 28 18:27:46.867988 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 28 18:27:46.867988 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 8ed514c8-e8b7-4207-aa09-817aa0cf2e66 is already attached to instances: c06cd5e6-1268-409e-9b59-2f29f39d1404 Jul 28 18:27:46.867988 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:27:46.867988 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:27:46.867988 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:27:46.867988 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:27:46.867988 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:27:46.869637 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:27:46.869637 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:27:46.869637 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:27:46.869637 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 8ed514c8-e8b7-4207-aa09-817aa0cf2e66 is already attached to instances: c06cd5e6-1268-409e-9b59-2f29f39d1404 Jul 28 18:27:46.869637 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:27:46.869637 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-7c845f17-ced5-447a-86ff-4a1c21f18598 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Returning 400 to user: Invalid volume: volume 8ed514c8-e8b7-4207-aa09-817aa0cf2e66 is already attached to instances: c06cd5e6-1268-409e-9b59-2f29f39d1404 {{(pid=118453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:27:46.869637 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-7c845f17-ced5-447a-86ff-4a1c21f18598 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "POST /compute/v2.1/servers/c06cd5e6-1268-409e-9b59-2f29f39d1404/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.151291 Jul 28 18:27:46.869637 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 615/1234] 10.222.0.86 () {60 vars in 1323 bytes} [Thu Jul 28 18:27:46 2022] POST /compute/v2.1/servers/c06cd5e6-1268-409e-9b59-2f29f39d1404/os-volume_attachments => generated 174 bytes in 152 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 18:27:46.932814 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-63f4a394-56c3-4473-81a1-717e059c126a tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:27:46.933472 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-63f4a394-56c3-4473-81a1-717e059c126a tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: c06cd5e6-1268-409e-9b59-2f29f39d1404] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:27:46.939731 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-63f4a394-56c3-4473-81a1-717e059c126a tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:27:46.940183 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-63f4a394-56c3-4473-81a1-717e059c126a tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:27:46.940988 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-63f4a394-56c3-4473-81a1-717e059c126a tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:27:46.941434 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-63f4a394-56c3-4473-81a1-717e059c126a tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:27:47.021513 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.objects.instance [None req-63f4a394-56c3-4473-81a1-717e059c126a tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lazy-loading 'services' on Instance uuid c06cd5e6-1268-409e-9b59-2f29f39d1404 {{(pid=118454) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:27:47.216620 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-63f4a394-56c3-4473-81a1-717e059c126a tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "DELETE /compute/v2.1/servers/c06cd5e6-1268-409e-9b59-2f29f39d1404/os-volume_attachments/8ed514c8-e8b7-4207-aa09-817aa0cf2e66" status: 202 len: 0 microversion: 2.1 time: 0.288965 Jul 28 18:27:47.217314 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 620/1235] 10.222.0.86 () {58 vars in 1416 bytes} [Thu Jul 28 18:27:46 2022] DELETE /compute/v2.1/servers/c06cd5e6-1268-409e-9b59-2f29f39d1404/os-volume_attachments/8ed514c8-e8b7-4207-aa09-817aa0cf2e66 => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 18:27:47.226380 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0f6ece2c-a9b4-4210-bb47-876e651d09b3 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:27:47.228624 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0f6ece2c-a9b4-4210-bb47-876e651d09b3 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: c06cd5e6-1268-409e-9b59-2f29f39d1404] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:27:47.234828 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0f6ece2c-a9b4-4210-bb47-876e651d09b3 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:27:47.235285 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0f6ece2c-a9b4-4210-bb47-876e651d09b3 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:27:47.236063 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0f6ece2c-a9b4-4210-bb47-876e651d09b3 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:27:47.236507 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0f6ece2c-a9b4-4210-bb47-876e651d09b3 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:27:47.269256 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0f6ece2c-a9b4-4210-bb47-876e651d09b3 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/c06cd5e6-1268-409e-9b59-2f29f39d1404/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047464 Jul 28 18:27:47.269900 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 616/1236] 10.222.0.86 () {58 vars in 1302 bytes} [Thu Jul 28 18:27:47 2022] GET /compute/v2.1/servers/c06cd5e6-1268-409e-9b59-2f29f39d1404/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:27:48.283048 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-1d1a5cb4-eb57-4c3d-94d0-c57c5bd4d91f tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:27:48.285459 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-1d1a5cb4-eb57-4c3d-94d0-c57c5bd4d91f tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: c06cd5e6-1268-409e-9b59-2f29f39d1404] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:27:48.292221 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-1d1a5cb4-eb57-4c3d-94d0-c57c5bd4d91f tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:27:48.292669 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-1d1a5cb4-eb57-4c3d-94d0-c57c5bd4d91f tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:27:48.293483 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-1d1a5cb4-eb57-4c3d-94d0-c57c5bd4d91f tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:27:48.293927 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-1d1a5cb4-eb57-4c3d-94d0-c57c5bd4d91f tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:27:48.328281 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-1d1a5cb4-eb57-4c3d-94d0-c57c5bd4d91f tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/c06cd5e6-1268-409e-9b59-2f29f39d1404/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049732 Jul 28 18:27:48.328859 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 621/1237] 10.222.0.86 () {58 vars in 1302 bytes} [Thu Jul 28 18:27:48 2022] GET /compute/v2.1/servers/c06cd5e6-1268-409e-9b59-2f29f39d1404/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:27:48.754305 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 18:27:48.754542 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Thu Jul 28 18:27:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 18:27:49.341177 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5ea0eafc-4901-4719-a91a-270d19a01c2a tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:27:49.344532 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-5ea0eafc-4901-4719-a91a-270d19a01c2a tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: c06cd5e6-1268-409e-9b59-2f29f39d1404] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:27:49.352109 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5ea0eafc-4901-4719-a91a-270d19a01c2a tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:27:49.352590 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5ea0eafc-4901-4719-a91a-270d19a01c2a tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:27:49.353399 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5ea0eafc-4901-4719-a91a-270d19a01c2a tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:27:49.353846 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5ea0eafc-4901-4719-a91a-270d19a01c2a tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:27:49.382942 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-5ea0eafc-4901-4719-a91a-270d19a01c2a tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/c06cd5e6-1268-409e-9b59-2f29f39d1404/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045915 Jul 28 18:27:49.383499 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 617/1238] 10.222.0.86 () {58 vars in 1302 bytes} [Thu Jul 28 18:27:49 2022] GET /compute/v2.1/servers/c06cd5e6-1268-409e-9b59-2f29f39d1404/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 18:27:49.443976 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-816072a8-fe54-4901-a3bf-14ea94443d49 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:27:49.444478 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-816072a8-fe54-4901-a3bf-14ea94443d49 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: c06cd5e6-1268-409e-9b59-2f29f39d1404] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:27:49.450907 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-816072a8-fe54-4901-a3bf-14ea94443d49 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:27:49.451358 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-816072a8-fe54-4901-a3bf-14ea94443d49 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:27:49.452117 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-816072a8-fe54-4901-a3bf-14ea94443d49 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:27:49.452553 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-816072a8-fe54-4901-a3bf-14ea94443d49 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:27:49.477401 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-816072a8-fe54-4901-a3bf-14ea94443d49 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: c06cd5e6-1268-409e-9b59-2f29f39d1404] Going to try to terminate instance {{(pid=118454) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 18:27:49.686389 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-816072a8-fe54-4901-a3bf-14ea94443d49 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "DELETE /compute/v2.1/servers/c06cd5e6-1268-409e-9b59-2f29f39d1404" status: 204 len: 0 microversion: 2.1 time: 0.245986 Jul 28 18:27:49.687096 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 622/1239] 10.222.0.86 () {58 vars in 1239 bytes} [Thu Jul 28 18:27:49 2022] DELETE /compute/v2.1/servers/c06cd5e6-1268-409e-9b59-2f29f39d1404 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 18:27:49.695050 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ca06c0be-28a1-4eb4-9763-bda74b67b07a tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:27:49.695686 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ca06c0be-28a1-4eb4-9763-bda74b67b07a tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: c06cd5e6-1268-409e-9b59-2f29f39d1404] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:27:49.701722 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ca06c0be-28a1-4eb4-9763-bda74b67b07a tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:27:49.702308 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ca06c0be-28a1-4eb4-9763-bda74b67b07a tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:27:49.703101 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ca06c0be-28a1-4eb4-9763-bda74b67b07a tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:27:49.703546 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ca06c0be-28a1-4eb4-9763-bda74b67b07a tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:27:49.835349 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ca06c0be-28a1-4eb4-9763-bda74b67b07a tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:27:49.843215 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ca06c0be-28a1-4eb4-9763-bda74b67b07a tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/c06cd5e6-1268-409e-9b59-2f29f39d1404" status: 200 len: 1680 microversion: 2.1 time: 0.151977 Jul 28 18:27:49.845585 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 618/1240] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:27:49 2022] GET /compute/v2.1/servers/c06cd5e6-1268-409e-9b59-2f29f39d1404 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:27:50.865615 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-eb01c57e-7e33-4998-8568-1fbe1638fd95 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:27:50.866462 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-eb01c57e-7e33-4998-8568-1fbe1638fd95 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: c06cd5e6-1268-409e-9b59-2f29f39d1404] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:27:50.873091 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-eb01c57e-7e33-4998-8568-1fbe1638fd95 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:27:50.873545 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-eb01c57e-7e33-4998-8568-1fbe1638fd95 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:27:50.874320 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-eb01c57e-7e33-4998-8568-1fbe1638fd95 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:27:50.874764 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-eb01c57e-7e33-4998-8568-1fbe1638fd95 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:27:51.011889 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-eb01c57e-7e33-4998-8568-1fbe1638fd95 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:27:51.019333 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-eb01c57e-7e33-4998-8568-1fbe1638fd95 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/c06cd5e6-1268-409e-9b59-2f29f39d1404" status: 200 len: 1680 microversion: 2.1 time: 0.158144 Jul 28 18:27:51.019898 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 623/1241] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:27:50 2022] GET /compute/v2.1/servers/c06cd5e6-1268-409e-9b59-2f29f39d1404 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:27:52.040744 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-4d4cb15f-1b12-46c1-99ee-3466bbe5a155 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:27:52.041391 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-4d4cb15f-1b12-46c1-99ee-3466bbe5a155 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: c06cd5e6-1268-409e-9b59-2f29f39d1404] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:27:52.048370 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4d4cb15f-1b12-46c1-99ee-3466bbe5a155 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:27:52.048923 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4d4cb15f-1b12-46c1-99ee-3466bbe5a155 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:27:52.049782 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4d4cb15f-1b12-46c1-99ee-3466bbe5a155 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:27:52.050298 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-4d4cb15f-1b12-46c1-99ee-3466bbe5a155 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:27:52.181522 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-4d4cb15f-1b12-46c1-99ee-3466bbe5a155 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:27:52.189045 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-4d4cb15f-1b12-46c1-99ee-3466bbe5a155 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/c06cd5e6-1268-409e-9b59-2f29f39d1404" status: 200 len: 1680 microversion: 2.1 time: 0.153207 Jul 28 18:27:52.189622 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 619/1242] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:27:52 2022] GET /compute/v2.1/servers/c06cd5e6-1268-409e-9b59-2f29f39d1404 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:27:52.715922 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [req-4a478679-5c4a-4d55-8f03-fbb84575d3e2 req-946053e7-799d-408b-923e-867e922b4ad7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c06cd5e6-1268-409e-9b59-2f29f39d1404", "name": "network-vif-deleted", "tag": "df048abb-6acb-481a-a577-df93a01ec1e6"}]} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:27:52.726540 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-4a478679-5c4a-4d55-8f03-fbb84575d3e2 req-946053e7-799d-408b-923e-867e922b4ad7 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:27:52.726976 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-4a478679-5c4a-4d55-8f03-fbb84575d3e2 req-946053e7-799d-408b-923e-867e922b4ad7 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:27:52.738260 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.compute.server_external_events [req-4a478679-5c4a-4d55-8f03-fbb84575d3e2 req-946053e7-799d-408b-923e-867e922b4ad7 service nova] Creating event network-vif-deleted:df048abb-6acb-481a-a577-df93a01ec1e6 for instance c06cd5e6-1268-409e-9b59-2f29f39d1404 on hv-cinder-84617 Jul 28 18:27:52.743558 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [req-4a478679-5c4a-4d55-8f03-fbb84575d3e2 req-946053e7-799d-408b-923e-867e922b4ad7 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031442 Jul 28 18:27:52.744318 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 624/1243] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:27:53.210878 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0488e3d1-4801-48f0-a04a-18ca6eccd3f8 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:27:53.211525 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0488e3d1-4801-48f0-a04a-18ca6eccd3f8 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: c06cd5e6-1268-409e-9b59-2f29f39d1404] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:27:53.218246 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0488e3d1-4801-48f0-a04a-18ca6eccd3f8 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:27:53.218704 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0488e3d1-4801-48f0-a04a-18ca6eccd3f8 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:27:53.219480 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0488e3d1-4801-48f0-a04a-18ca6eccd3f8 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:27:53.219925 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0488e3d1-4801-48f0-a04a-18ca6eccd3f8 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:27:53.251975 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0488e3d1-4801-48f0-a04a-18ca6eccd3f8 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:27:53.252430 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0488e3d1-4801-48f0-a04a-18ca6eccd3f8 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:27:53.252882 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.objects.instance [None req-0488e3d1-4801-48f0-a04a-18ca6eccd3f8 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lazy-loading 'fault' on Instance uuid c06cd5e6-1268-409e-9b59-2f29f39d1404 {{(pid=118453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:27:53.293650 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-0488e3d1-4801-48f0-a04a-18ca6eccd3f8 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:27:53.301202 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0488e3d1-4801-48f0-a04a-18ca6eccd3f8 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/c06cd5e6-1268-409e-9b59-2f29f39d1404" status: 200 len: 1330 microversion: 2.1 time: 0.094278 Jul 28 18:27:53.301779 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 620/1244] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:27:53 2022] GET /compute/v2.1/servers/c06cd5e6-1268-409e-9b59-2f29f39d1404 => generated 1330 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:27:54.323869 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-73ff3416-c407-499f-a258-3a71c67940d9 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:27:54.324574 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-73ff3416-c407-499f-a258-3a71c67940d9 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: c06cd5e6-1268-409e-9b59-2f29f39d1404] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:27:54.330767 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-73ff3416-c407-499f-a258-3a71c67940d9 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:27:54.331476 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-73ff3416-c407-499f-a258-3a71c67940d9 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:27:54.332244 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-73ff3416-c407-499f-a258-3a71c67940d9 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:27:54.332685 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-73ff3416-c407-499f-a258-3a71c67940d9 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:27:54.345657 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.wsgi [None req-73ff3416-c407-499f-a258-3a71c67940d9 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] HTTP exception thrown: Instance c06cd5e6-1268-409e-9b59-2f29f39d1404 could not be found. Jul 28 18:27:54.347259 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-73ff3416-c407-499f-a258-3a71c67940d9 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Request method failure captured: Jul 28 18:27:54.347259 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: request: GET /compute/v2.1/servers/c06cd5e6-1268-409e-9b59-2f29f39d1404 HTTP/1.1 Jul 28 18:27:54.347259 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Accept: application/json Jul 28 18:27:54.347259 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Accept-Encoding: identity Jul 28 18:27:54.347259 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Connection: close Jul 28 18:27:54.347259 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Content-Length: 0 Jul 28 18:27:54.347259 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Content-Type: application/json Jul 28 18:27:54.347259 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Host: 10.222.0.86 Jul 28 18:27:54.347259 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Openstack-System-Scope: None Jul 28 18:27:54.347259 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: User-Agent: python-urllib3/1.26.10 Jul 28 18:27:54.347259 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Auth-Token: gAAAAABi4tOBTGRF9y9OAlefXy84t2lwOcq7Yp99X6H1ahc3ofs3Ehb5kBGF_9CYSBI80Rx8VFnnn80tQOz0U481VovOm_qAsLcyBFR5gizgfkClDfG1sybWskPJqHUNFOgadZvxg94hprAbcyZjmqgKLYfGkC4nDrgrf7oV07qvZWjTmYx3f6M Jul 28 18:27:54.347259 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Domain-Id: None Jul 28 18:27:54.347259 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Domain-Name: None Jul 28 18:27:54.347259 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Identity-Status: Confirmed Jul 28 18:27:54.347259 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Is-Admin-Project: True Jul 28 18:27:54.347259 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Domain-Id: default Jul 28 18:27:54.347259 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Domain-Name: Default Jul 28 18:27:54.347259 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Id: 104313ce72c94ea68c8cd3ee7f0cab2e Jul 28 18:27:54.347259 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Name: tempest-AttachVolumeNegativeTest-908754065 Jul 28 18:27:54.347259 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Role: member,reader Jul 28 18:27:54.347259 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Roles: member,reader Jul 28 18:27:54.348908 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_104313ce72c94ea68c8cd3ee7f0cab2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/104313ce72c94ea68c8cd3ee7f0cab2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/104313ce72c94ea68c8cd3ee7f0cab2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/104313ce72c94ea68c8cd3ee7f0cab2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}] Jul 28 18:27:54.348908 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant: tempest-AttachVolumeNegativeTest-908754065 Jul 28 18:27:54.348908 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant-Id: 104313ce72c94ea68c8cd3ee7f0cab2e Jul 28 18:27:54.348908 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-908754065 Jul 28 18:27:54.348908 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User: tempest-AttachVolumeNegativeTest-908754065-project Jul 28 18:27:54.348908 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Domain-Id: default Jul 28 18:27:54.348908 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Domain-Name: Default Jul 28 18:27:54.348908 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Id: e2b1f1c4bb2747e0845cdc2991e53b09 Jul 28 18:27:54.348908 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Name: tempest-AttachVolumeNegativeTest-908754065-project Jul 28 18:27:54.348908 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: method: > Jul 28 18:27:54.348908 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: exception: Instance c06cd5e6-1268-409e-9b59-2f29f39d1404 could not be found. Jul 28 18:27:54.348908 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: action_args: {'id': 'c06cd5e6-1268-409e-9b59-2f29f39d1404'} Jul 28 18:27:54.349889 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:27:54.349889 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:27:54.349889 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:27:54.349889 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:27:54.349889 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:27:54.349889 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:27:54.349889 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:27:54.349889 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:27:54.349889 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:27:54.349889 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:27:54.349889 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c06cd5e6-1268-409e-9b59-2f29f39d1404 could not be found. Jul 28 18:27:54.349889 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:27:54.349889 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:27:54.349889 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:27:54.349889 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:27:54.349889 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:27:54.349889 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:27:54.349889 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:27:54.349889 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:27:54.349889 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:27:54.351178 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:27:54.351178 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 18:27:54.351178 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 18:27:54.351178 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:27:54.351178 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:27:54.351178 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:27:54.351178 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:27:54.351178 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c06cd5e6-1268-409e-9b59-2f29f39d1404 could not be found. Jul 28 18:27:54.351178 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:27:54.351178 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:27:54.351178 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:27:54.351178 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:27:54.351178 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:27:54.351178 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:27:54.351178 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:27:54.351178 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:27:54.351178 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c06cd5e6-1268-409e-9b59-2f29f39d1404 could not be found. Jul 28 18:27:54.351178 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:27:54.352770 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-73ff3416-c407-499f-a258-3a71c67940d9 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Returning 404 to user: Instance c06cd5e6-1268-409e-9b59-2f29f39d1404 could not be found. {{(pid=118454) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:27:54.352770 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-73ff3416-c407-499f-a258-3a71c67940d9 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/c06cd5e6-1268-409e-9b59-2f29f39d1404" status: 404 len: 111 microversion: 2.1 time: 0.030109 Jul 28 18:27:54.352770 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 625/1245] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:27:54 2022] GET /compute/v2.1/servers/c06cd5e6-1268-409e-9b59-2f29f39d1404 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:27:54.357469 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-b76ae95e-d838-42b6-8f45-35bb67311292 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '.version_select at 0x7f6fe6cd44c0>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:27:54.443054 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-b76ae95e-d838-42b6-8f45-35bb67311292 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-330440370" status: 202 len: 0 microversion: 2.1 time: 0.089328 Jul 28 18:27:54.444121 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 621/1246] 10.222.0.86 () {58 vars in 1218 bytes} [Thu Jul 28 18:27:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-330440370 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 18:27:55.220049 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-75ded816-74d0-4ca3-9489-c6dcefebf145 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Action: 'create', calling method: .version_select at 0x7f6fe2655040>, body: {"keypair": {"name": "tempest-keypair-1827072790", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA7WHuA94WjZJzgl0KIAG5HPiem+xRCcRVm7wx5j6pn9QcdfpblCUIO4c8/dKrJuR+KHTKeV76B+Rb/ZruFyYHa0N8+hE0rRBfD3eJExtpp7Crm+lH5J8GRQMnlCWongCQ=="}} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:27:55.235630 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.quota [None req-75ded816-74d0-4ca3-9489-c6dcefebf145 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Getting quotas for project 104313ce72c94ea68c8cd3ee7f0cab2e. Resources: {'key_pairs'} {{(pid=118454) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 18:27:55.239458 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.quota [None req-75ded816-74d0-4ca3-9489-c6dcefebf145 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Getting quotas for user e2b1f1c4bb2747e0845cdc2991e53b09 and project 104313ce72c94ea68c8cd3ee7f0cab2e. Resources: {'key_pairs'} {{(pid=118454) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 18:27:55.327149 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-75ded816-74d0-4ca3-9489-c6dcefebf145 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.110984 Jul 28 18:27:55.327779 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 626/1247] 10.222.0.86 () {60 vars in 1159 bytes} [Thu Jul 28 18:27:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:27:57.500254 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-55ecb178-5422-4545-b051-10e4638e04e8 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-778392475", "imageRef": "61912422-61cd-4ced-a573-85ee305e010f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "44a25a1e-08cb-4158-9e81-b93066923b4d"}], "security_groups": [{"name": "tempest-securitygroup--1892445931"}], "key_name": "tempest-keypair-1827072790", "user_data": "}} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:27:57.604361 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.network.neutron [None req-55ecb178-5422-4545-b051-10e4638e04e8 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] validate_networks() for [('44a25a1e-08cb-4158-9e81-b93066923b4d', None, None, None, None, None)] {{(pid=118453) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 18:27:57.968749 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-55ecb178-5422-4545-b051-10e4638e04e8 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Flavor limits 0:0:0 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 18:27:57.969232 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-55ecb178-5422-4545-b051-10e4638e04e8 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Image limits 0:0:0 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 18:27:57.969710 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-55ecb178-5422-4545-b051-10e4638e04e8 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Flavor pref 0:0:0 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 18:27:57.970145 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-55ecb178-5422-4545-b051-10e4638e04e8 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Image pref 0:0:0 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 18:27:57.970561 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-55ecb178-5422-4545-b051-10e4638e04e8 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 18:27:57.980350 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-55ecb178-5422-4545-b051-10e4638e04e8 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:27:57.980796 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-55ecb178-5422-4545-b051-10e4638e04e8 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:27:57.981627 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-55ecb178-5422-4545-b051-10e4638e04e8 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:27:57.982062 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-55ecb178-5422-4545-b051-10e4638e04e8 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:27:57.998332 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.quota [None req-55ecb178-5422-4545-b051-10e4638e04e8 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Getting quotas for project 104313ce72c94ea68c8cd3ee7f0cab2e. Resources: {'cores', 'ram', 'instances'} {{(pid=118453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 18:27:58.002159 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.quota [None req-55ecb178-5422-4545-b051-10e4638e04e8 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Getting quotas for user e2b1f1c4bb2747e0845cdc2991e53b09 and project 104313ce72c94ea68c8cd3ee7f0cab2e. Resources: {'cores', 'ram', 'instances'} {{(pid=118453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 18:27:58.012851 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-55ecb178-5422-4545-b051-10e4638e04e8 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Going to run 1 instances... {{(pid=118453) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 18:27:58.015116 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-55ecb178-5422-4545-b051-10e4638e04e8 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='61912422-61cd-4ced-a573-85ee305e010f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 18:27:58.143131 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR oslo.messaging._drivers.impl_rabbit [None req-55ecb178-5422-4545-b051-10e4638e04e8 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [9fc507cb-62e6-46b0-96e5-cba623eafec2] AMQP server on 10.222.0.86:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 28 18:27:59.150522 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO oslo.messaging._drivers.impl_rabbit [None req-55ecb178-5422-4545-b051-10e4638e04e8 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [9fc507cb-62e6-46b0-96e5-cba623eafec2] Reconnected to AMQP server on 10.222.0.86:5672 via [amqp] client with port 56044. Jul 28 18:27:59.154962 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-55ecb178-5422-4545-b051-10e4638e04e8 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.659707 Jul 28 18:27:59.155620 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 622/1248] 10.222.0.86 () {60 vars in 1147 bytes} [Thu Jul 28 18:27:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 1661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 18:27:59.167936 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-739a1662-aa80-4572-bf98-30186f7f734c tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:27:59.168613 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-739a1662-aa80-4572-bf98-30186f7f734c tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:27:59.227065 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-739a1662-aa80-4572-bf98-30186f7f734c tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:27:59.233940 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-739a1662-aa80-4572-bf98-30186f7f734c tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3" status: 200 len: 1241 microversion: 2.1 time: 0.070704 Jul 28 18:27:59.234485 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 627/1249] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:27:59 2022] GET /compute/v2.1/servers/d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3 => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:28:00.256067 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-c7c2d2d6-faa3-4da0-9fa6-8f526ad79967 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:28:00.256682 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-c7c2d2d6-faa3-4da0-9fa6-8f526ad79967 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:28:00.262817 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c7c2d2d6-faa3-4da0-9fa6-8f526ad79967 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:28:00.266180 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c7c2d2d6-faa3-4da0-9fa6-8f526ad79967 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:28:00.266180 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c7c2d2d6-faa3-4da0-9fa6-8f526ad79967 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:28:00.266180 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c7c2d2d6-faa3-4da0-9fa6-8f526ad79967 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:28:00.327277 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-c7c2d2d6-faa3-4da0-9fa6-8f526ad79967 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:28:00.334981 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-c7c2d2d6-faa3-4da0-9fa6-8f526ad79967 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3" status: 200 len: 1245 microversion: 2.1 time: 0.083951 Jul 28 18:28:00.335547 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 623/1250] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:28:00 2022] GET /compute/v2.1/servers/d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:28:01.358712 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-4758c6f4-a70f-4dc7-bbca-cd2d56ae8ee2 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:28:01.359345 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-4758c6f4-a70f-4dc7-bbca-cd2d56ae8ee2 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:28:01.366364 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-4758c6f4-a70f-4dc7-bbca-cd2d56ae8ee2 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:28:01.366821 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-4758c6f4-a70f-4dc7-bbca-cd2d56ae8ee2 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:28:01.367613 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-4758c6f4-a70f-4dc7-bbca-cd2d56ae8ee2 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:28:01.368075 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-4758c6f4-a70f-4dc7-bbca-cd2d56ae8ee2 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:28:01.440609 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-4758c6f4-a70f-4dc7-bbca-cd2d56ae8ee2 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:28:01.452497 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-4758c6f4-a70f-4dc7-bbca-cd2d56ae8ee2 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3" status: 200 len: 1311 microversion: 2.1 time: 0.100670 Jul 28 18:28:01.453207 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 628/1251] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:28:01 2022] GET /compute/v2.1/servers/d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3 => generated 1311 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:28:02.475073 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-90498c33-f5ce-4a56-bacb-42ad318fc339 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:28:02.475689 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-90498c33-f5ce-4a56-bacb-42ad318fc339 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:28:02.482451 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-90498c33-f5ce-4a56-bacb-42ad318fc339 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:28:02.482959 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-90498c33-f5ce-4a56-bacb-42ad318fc339 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:28:02.484052 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-90498c33-f5ce-4a56-bacb-42ad318fc339 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:28:02.484523 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-90498c33-f5ce-4a56-bacb-42ad318fc339 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:28:02.616106 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-90498c33-f5ce-4a56-bacb-42ad318fc339 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:28:02.623644 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-90498c33-f5ce-4a56-bacb-42ad318fc339 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3" status: 200 len: 1367 microversion: 2.1 time: 0.152754 Jul 28 18:28:02.624291 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 624/1252] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:28:02 2022] GET /compute/v2.1/servers/d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:28:03.153849 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [req-32a3ca32-510e-477d-8184-ed43db245030 req-4d1780ac-dafb-442c-9be4-5f1428f31f04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3", "tag": "41469e01-6c85-42ff-801f-a96fa20eb490"}]} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:28:03.165567 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-32a3ca32-510e-477d-8184-ed43db245030 req-4d1780ac-dafb-442c-9be4-5f1428f31f04 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:28:03.169439 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-32a3ca32-510e-477d-8184-ed43db245030 req-4d1780ac-dafb-442c-9be4-5f1428f31f04 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:28:03.182407 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.compute.server_external_events [req-32a3ca32-510e-477d-8184-ed43db245030 req-4d1780ac-dafb-442c-9be4-5f1428f31f04 service nova] Creating event network-changed:41469e01-6c85-42ff-801f-a96fa20eb490 for instance d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3 on hv-cinder-84617 Jul 28 18:28:03.187608 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [req-32a3ca32-510e-477d-8184-ed43db245030 req-4d1780ac-dafb-442c-9be4-5f1428f31f04 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037868 Jul 28 18:28:03.188514 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 629/1253] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:28:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:28:03.644726 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-08308f72-83f6-4ccc-8068-5500db90ed42 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:28:03.645295 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-08308f72-83f6-4ccc-8068-5500db90ed42 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:28:03.651897 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-08308f72-83f6-4ccc-8068-5500db90ed42 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:28:03.652347 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-08308f72-83f6-4ccc-8068-5500db90ed42 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:28:03.653140 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-08308f72-83f6-4ccc-8068-5500db90ed42 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:28:03.653581 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-08308f72-83f6-4ccc-8068-5500db90ed42 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:28:03.785871 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-08308f72-83f6-4ccc-8068-5500db90ed42 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:28:03.794537 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-08308f72-83f6-4ccc-8068-5500db90ed42 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3" status: 200 len: 1367 microversion: 2.1 time: 0.153545 Jul 28 18:28:03.797449 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 625/1254] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:28:03 2022] GET /compute/v2.1/servers/d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:28:04.819369 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-5a446dc8-c44f-49a5-a0d9-3e34f64fa3f6 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:28:04.820010 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-5a446dc8-c44f-49a5-a0d9-3e34f64fa3f6 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:28:04.828602 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-5a446dc8-c44f-49a5-a0d9-3e34f64fa3f6 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:28:04.829106 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-5a446dc8-c44f-49a5-a0d9-3e34f64fa3f6 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:28:04.829865 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-5a446dc8-c44f-49a5-a0d9-3e34f64fa3f6 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:28:04.830296 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-5a446dc8-c44f-49a5-a0d9-3e34f64fa3f6 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:28:04.962564 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-5a446dc8-c44f-49a5-a0d9-3e34f64fa3f6 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:28:04.970219 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-5a446dc8-c44f-49a5-a0d9-3e34f64fa3f6 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3" status: 200 len: 1367 microversion: 2.1 time: 0.156271 Jul 28 18:28:04.970798 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 630/1255] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:28:04 2022] GET /compute/v2.1/servers/d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:28:05.991410 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ad415521-39fe-4204-a8dc-e6262f428e76 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:28:05.992026 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ad415521-39fe-4204-a8dc-e6262f428e76 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:28:05.998755 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ad415521-39fe-4204-a8dc-e6262f428e76 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:28:05.999217 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ad415521-39fe-4204-a8dc-e6262f428e76 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:28:05.999979 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ad415521-39fe-4204-a8dc-e6262f428e76 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:28:06.000433 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-ad415521-39fe-4204-a8dc-e6262f428e76 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:28:06.398629 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ad415521-39fe-4204-a8dc-e6262f428e76 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:28:06.406799 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ad415521-39fe-4204-a8dc-e6262f428e76 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3" status: 200 len: 1367 microversion: 2.1 time: 0.419316 Jul 28 18:28:06.407378 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 626/1256] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:28:05 2022] GET /compute/v2.1/servers/d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3 => generated 1367 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:28:07.428081 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-04ec3c54-08b9-4430-a1c5-6b65c94d3645 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:28:07.428712 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-04ec3c54-08b9-4430-a1c5-6b65c94d3645 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:28:07.431230 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:28:07.436021 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-04ec3c54-08b9-4430-a1c5-6b65c94d3645 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:28:07.436472 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-04ec3c54-08b9-4430-a1c5-6b65c94d3645 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:28:07.437277 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-04ec3c54-08b9-4430-a1c5-6b65c94d3645 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:28:07.437723 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-04ec3c54-08b9-4430-a1c5-6b65c94d3645 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:28:07.440635 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:28:07.577874 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-04ec3c54-08b9-4430-a1c5-6b65c94d3645 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:28:07.586630 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-04ec3c54-08b9-4430-a1c5-6b65c94d3645 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3" status: 200 len: 1367 microversion: 2.1 time: 0.163360 Jul 28 18:28:07.587195 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 631/1257] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:28:07 2022] GET /compute/v2.1/servers/d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:28:08.607746 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-bc7a6347-f9b0-4237-81cd-31a30d8aaca0 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:28:08.616010 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-bc7a6347-f9b0-4237-81cd-31a30d8aaca0 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:28:08.616010 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell0:SELECT=2 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:28:08.616010 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell0:SELECT=6 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:28:08.616581 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bc7a6347-f9b0-4237-81cd-31a30d8aaca0 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:28:08.617074 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bc7a6347-f9b0-4237-81cd-31a30d8aaca0 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:28:08.617841 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bc7a6347-f9b0-4237-81cd-31a30d8aaca0 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:28:08.618285 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-bc7a6347-f9b0-4237-81cd-31a30d8aaca0 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:28:08.750933 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-bc7a6347-f9b0-4237-81cd-31a30d8aaca0 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:28:08.758921 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-bc7a6347-f9b0-4237-81cd-31a30d8aaca0 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3" status: 200 len: 1367 microversion: 2.1 time: 0.155078 Jul 28 18:28:08.759516 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 627/1258] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:28:08 2022] GET /compute/v2.1/servers/d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:28:09.779726 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-7a4205ff-d41e-4aa3-823c-dacacde350b4 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:28:09.780349 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-7a4205ff-d41e-4aa3-823c-dacacde350b4 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:28:09.783315 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell0:SELECT=6 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:28:09.789365 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-7a4205ff-d41e-4aa3-823c-dacacde350b4 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:28:09.795030 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-7a4205ff-d41e-4aa3-823c-dacacde350b4 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:28:09.795030 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-7a4205ff-d41e-4aa3-823c-dacacde350b4 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:28:09.795030 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-7a4205ff-d41e-4aa3-823c-dacacde350b4 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:28:09.928877 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-7a4205ff-d41e-4aa3-823c-dacacde350b4 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:28:09.936469 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-7a4205ff-d41e-4aa3-823c-dacacde350b4 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3" status: 200 len: 1367 microversion: 2.1 time: 0.160661 Jul 28 18:28:09.937060 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 632/1259] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:28:09 2022] GET /compute/v2.1/servers/d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:28:10.608170 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-d16f35a8-7836-4336-8b08-906dcae80902 req-62ba5fd2-c5ad-4d0d-9aaf-5f035e18cc4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3", "name": "network-vif-plugged", "status": "completed", "tag": "41469e01-6c85-42ff-801f-a96fa20eb490"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:28:10.618269 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-d16f35a8-7836-4336-8b08-906dcae80902 req-62ba5fd2-c5ad-4d0d-9aaf-5f035e18cc4c service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:28:10.618717 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-d16f35a8-7836-4336-8b08-906dcae80902 req-62ba5fd2-c5ad-4d0d-9aaf-5f035e18cc4c service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:28:10.629284 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-d16f35a8-7836-4336-8b08-906dcae80902 req-62ba5fd2-c5ad-4d0d-9aaf-5f035e18cc4c service nova] Creating event network-vif-plugged:41469e01-6c85-42ff-801f-a96fa20eb490 for instance d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3 on hv-cinder-84617 Jul 28 18:28:10.634253 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-d16f35a8-7836-4336-8b08-906dcae80902 req-62ba5fd2-c5ad-4d0d-9aaf-5f035e18cc4c service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029992 Jul 28 18:28:10.634798 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 628/1260] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:28:10.956770 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-5e0e7473-14a0-4fc1-a95f-3aefe4d05fa8 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:28:10.957535 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-5e0e7473-14a0-4fc1-a95f-3aefe4d05fa8 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:28:10.964770 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-5e0e7473-14a0-4fc1-a95f-3aefe4d05fa8 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:28:10.965256 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-5e0e7473-14a0-4fc1-a95f-3aefe4d05fa8 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:28:10.966063 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-5e0e7473-14a0-4fc1-a95f-3aefe4d05fa8 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:28:10.966508 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-5e0e7473-14a0-4fc1-a95f-3aefe4d05fa8 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:28:11.098185 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-5e0e7473-14a0-4fc1-a95f-3aefe4d05fa8 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:28:11.105706 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-5e0e7473-14a0-4fc1-a95f-3aefe4d05fa8 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3" status: 200 len: 1367 microversion: 2.1 time: 0.153064 Jul 28 18:28:11.106277 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 633/1261] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:28:10 2022] GET /compute/v2.1/servers/d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:28:12.127099 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-59a68c7d-71d0-4476-ac8e-54403964bd02 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:28:12.127792 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-59a68c7d-71d0-4476-ac8e-54403964bd02 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:28:12.134634 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-59a68c7d-71d0-4476-ac8e-54403964bd02 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:28:12.135080 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-59a68c7d-71d0-4476-ac8e-54403964bd02 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:28:12.135836 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-59a68c7d-71d0-4476-ac8e-54403964bd02 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:28:12.136276 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-59a68c7d-71d0-4476-ac8e-54403964bd02 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:28:12.263903 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-59a68c7d-71d0-4476-ac8e-54403964bd02 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:28:12.271479 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-59a68c7d-71d0-4476-ac8e-54403964bd02 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3" status: 200 len: 1367 microversion: 2.1 time: 0.149047 Jul 28 18:28:12.272050 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 629/1262] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:28:12 2022] GET /compute/v2.1/servers/d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:28:13.291777 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-e4021742-dffb-463a-9d1f-b3797e5c6623 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:28:13.292409 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-e4021742-dffb-463a-9d1f-b3797e5c6623 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:28:13.298877 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e4021742-dffb-463a-9d1f-b3797e5c6623 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:28:13.299322 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e4021742-dffb-463a-9d1f-b3797e5c6623 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:28:13.300075 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e4021742-dffb-463a-9d1f-b3797e5c6623 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:28:13.300508 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-e4021742-dffb-463a-9d1f-b3797e5c6623 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:28:13.428384 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-e4021742-dffb-463a-9d1f-b3797e5c6623 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:28:13.435967 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-e4021742-dffb-463a-9d1f-b3797e5c6623 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3" status: 200 len: 1558 microversion: 2.1 time: 0.148070 Jul 28 18:28:13.436526 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 634/1263] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:28:13 2022] GET /compute/v2.1/servers/d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:28:13.456592 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-56ab0183-789a-493a-baca-178696b8ad1e tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:28:13.457132 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-56ab0183-789a-493a-baca-178696b8ad1e tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:28:13.464163 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-56ab0183-789a-493a-baca-178696b8ad1e tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:28:13.464614 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-56ab0183-789a-493a-baca-178696b8ad1e tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:28:13.465416 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-56ab0183-789a-493a-baca-178696b8ad1e tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:28:13.465860 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-56ab0183-789a-493a-baca-178696b8ad1e tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:28:13.545983 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-56ab0183-789a-493a-baca-178696b8ad1e tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093511 Jul 28 18:28:13.546581 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 630/1264] 10.222.0.86 () {58 vars in 1275 bytes} [Thu Jul 28 18:28:13 2022] GET /compute/v2.1/servers/d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:28:14.539484 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [req-49d7f705-ed72-44f0-acf9-509b06088c02 req-124a7e50-2cc1-44b8-a5b8-c9c49fbcc2ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3", "tag": "41469e01-6c85-42ff-801f-a96fa20eb490"}]} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:28:14.550861 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-49d7f705-ed72-44f0-acf9-509b06088c02 req-124a7e50-2cc1-44b8-a5b8-c9c49fbcc2ed service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:28:14.551393 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-49d7f705-ed72-44f0-acf9-509b06088c02 req-124a7e50-2cc1-44b8-a5b8-c9c49fbcc2ed service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:28:14.562311 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.compute.server_external_events [req-49d7f705-ed72-44f0-acf9-509b06088c02 req-124a7e50-2cc1-44b8-a5b8-c9c49fbcc2ed service nova] Creating event network-changed:41469e01-6c85-42ff-801f-a96fa20eb490 for instance d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3 on hv-cinder-84617 Jul 28 18:28:14.567335 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [req-49d7f705-ed72-44f0-acf9-509b06088c02 req-124a7e50-2cc1-44b8-a5b8-c9c49fbcc2ed service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032053 Jul 28 18:28:14.568187 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 635/1265] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:28:20.491593 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-0382c543-c5ae-4def-b0b7-7dc00b4faa7f tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1396800375"}} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:28:20.492162 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-0382c543-c5ae-4def-b0b7-7dc00b4faa7f tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] [instance: 0308fa68-38a8-43e2-8e64-6de4f4a28f73] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:28:20.494165 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=51,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:28:20.498974 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0382c543-c5ae-4def-b0b7-7dc00b4faa7f tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:28:20.499424 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0382c543-c5ae-4def-b0b7-7dc00b4faa7f tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:28:20.500191 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0382c543-c5ae-4def-b0b7-7dc00b4faa7f tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:28:20.500630 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-0382c543-c5ae-4def-b0b7-7dc00b4faa7f tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:28:20.504191 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=87 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:28:20.631395 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.network.security_group_api [None req-0382c543-c5ae-4def-b0b7-7dc00b4faa7f tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Removing security group fdae437d-3bc6-4299-8596-13291fc24e24 from port fffe897d-12c2-45ef-b241-0a4c420fa5f6 Jul 28 18:28:21.027822 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-0382c543-c5ae-4def-b0b7-7dc00b4faa7f tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] 10.222.0.86 "POST /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73/action" status: 202 len: 0 microversion: 2.1 time: 0.541264 Jul 28 18:28:21.033439 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 631/1266] 10.222.0.86 () {60 vars in 1278 bytes} [Thu Jul 28 18:28:20 2022] POST /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73/action => generated 0 bytes in 546 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 18:28:21.116447 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [req-4971632d-9e23-44c2-96ac-db93a6270e1a req-3027a162-69e3-4b24-8e11-3a616c4e8d62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0308fa68-38a8-43e2-8e64-6de4f4a28f73", "tag": "fffe897d-12c2-45ef-b241-0a4c420fa5f6"}]} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:28:21.129891 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-4971632d-9e23-44c2-96ac-db93a6270e1a req-3027a162-69e3-4b24-8e11-3a616c4e8d62 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:28:21.130431 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-4971632d-9e23-44c2-96ac-db93a6270e1a req-3027a162-69e3-4b24-8e11-3a616c4e8d62 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:28:21.144718 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.compute.server_external_events [req-4971632d-9e23-44c2-96ac-db93a6270e1a req-3027a162-69e3-4b24-8e11-3a616c4e8d62 service nova] Creating event network-changed:fffe897d-12c2-45ef-b241-0a4c420fa5f6 for instance 0308fa68-38a8-43e2-8e64-6de4f4a28f73 on hv-cinder-84617 Jul 28 18:28:21.152542 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [req-4971632d-9e23-44c2-96ac-db93a6270e1a req-3027a162-69e3-4b24-8e11-3a616c4e8d62 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114028 Jul 28 18:28:21.153680 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 636/1267] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:28:22.383688 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5ecf2fc8-2f6d-49bf-b75b-3cc274caf359 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:28:22.384290 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-5ecf2fc8-2f6d-49bf-b75b-3cc274caf359 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] [instance: 0308fa68-38a8-43e2-8e64-6de4f4a28f73] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:28:22.390401 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5ecf2fc8-2f6d-49bf-b75b-3cc274caf359 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:28:22.390916 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5ecf2fc8-2f6d-49bf-b75b-3cc274caf359 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:28:22.391757 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5ecf2fc8-2f6d-49bf-b75b-3cc274caf359 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:28:22.392260 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5ecf2fc8-2f6d-49bf-b75b-3cc274caf359 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:28:22.472945 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.objects.instance [None req-5ecf2fc8-2f6d-49bf-b75b-3cc274caf359 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lazy-loading 'services' on Instance uuid 0308fa68-38a8-43e2-8e64-6de4f4a28f73 {{(pid=118453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:28:22.650362 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-5ecf2fc8-2f6d-49bf-b75b-3cc274caf359 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] 10.222.0.86 "DELETE /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73/os-volume_attachments/d4ab8163-df2b-4910-bf6b-e245f054e3ed" status: 202 len: 0 microversion: 2.1 time: 0.271668 Jul 28 18:28:22.651688 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 632/1268] 10.222.0.86 () {58 vars in 1416 bytes} [Thu Jul 28 18:28:22 2022] DELETE /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73/os-volume_attachments/d4ab8163-df2b-4910-bf6b-e245f054e3ed => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 18:28:22.660741 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-6b610edc-6b48-4ab4-91da-8f926edc1e88 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:28:22.664335 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-6b610edc-6b48-4ab4-91da-8f926edc1e88 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] [instance: 0308fa68-38a8-43e2-8e64-6de4f4a28f73] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:28:22.672227 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-6b610edc-6b48-4ab4-91da-8f926edc1e88 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:28:22.672683 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-6b610edc-6b48-4ab4-91da-8f926edc1e88 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:28:22.674446 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-6b610edc-6b48-4ab4-91da-8f926edc1e88 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:28:22.674446 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-6b610edc-6b48-4ab4-91da-8f926edc1e88 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:28:22.706173 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-6b610edc-6b48-4ab4-91da-8f926edc1e88 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] 10.222.0.86 "GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050582 Jul 28 18:28:22.706756 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 637/1269] 10.222.0.86 () {58 vars in 1302 bytes} [Thu Jul 28 18:28:22 2022] GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:28:23.168899 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-4ceb922b-a9ff-4884-95ce-a70beca47248 req-f2a094f3-cd67-4c07-a85f-cc50de1c4c7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0308fa68-38a8-43e2-8e64-6de4f4a28f73", "tag": "fffe897d-12c2-45ef-b241-0a4c420fa5f6"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:28:23.179687 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-4ceb922b-a9ff-4884-95ce-a70beca47248 req-f2a094f3-cd67-4c07-a85f-cc50de1c4c7c service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:28:23.185149 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-4ceb922b-a9ff-4884-95ce-a70beca47248 req-f2a094f3-cd67-4c07-a85f-cc50de1c4c7c service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:28:23.191610 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-4ceb922b-a9ff-4884-95ce-a70beca47248 req-f2a094f3-cd67-4c07-a85f-cc50de1c4c7c service nova] Creating event network-changed:fffe897d-12c2-45ef-b241-0a4c420fa5f6 for instance 0308fa68-38a8-43e2-8e64-6de4f4a28f73 on hv-cinder-84617 Jul 28 18:28:23.196909 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-4ceb922b-a9ff-4884-95ce-a70beca47248 req-f2a094f3-cd67-4c07-a85f-cc50de1c4c7c service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031743 Jul 28 18:28:23.197718 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 633/1270] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:28:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:28:23.718995 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-c1c256f4-dc0e-401b-943c-76a18dfba8c3 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:28:23.721222 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-c1c256f4-dc0e-401b-943c-76a18dfba8c3 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] [instance: 0308fa68-38a8-43e2-8e64-6de4f4a28f73] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:28:23.731097 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c1c256f4-dc0e-401b-943c-76a18dfba8c3 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:28:23.731798 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c1c256f4-dc0e-401b-943c-76a18dfba8c3 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:28:23.732653 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c1c256f4-dc0e-401b-943c-76a18dfba8c3 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:28:23.733229 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c1c256f4-dc0e-401b-943c-76a18dfba8c3 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:28:23.764923 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-c1c256f4-dc0e-401b-943c-76a18dfba8c3 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] 10.222.0.86 "GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050063 Jul 28 18:28:23.765511 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 638/1271] 10.222.0.86 () {58 vars in 1302 bytes} [Thu Jul 28 18:28:23 2022] GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:28:24.778388 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-e43129fc-6fa4-4289-ae71-91b9d90e5c79 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:28:24.780798 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-e43129fc-6fa4-4289-ae71-91b9d90e5c79 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] [instance: 0308fa68-38a8-43e2-8e64-6de4f4a28f73] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:28:24.788210 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e43129fc-6fa4-4289-ae71-91b9d90e5c79 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:28:24.788665 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e43129fc-6fa4-4289-ae71-91b9d90e5c79 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:28:24.789468 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e43129fc-6fa4-4289-ae71-91b9d90e5c79 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:28:24.789899 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e43129fc-6fa4-4289-ae71-91b9d90e5c79 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:28:24.818105 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-e43129fc-6fa4-4289-ae71-91b9d90e5c79 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] 10.222.0.86 "GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044082 Jul 28 18:28:24.819067 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 634/1272] 10.222.0.86 () {58 vars in 1302 bytes} [Thu Jul 28 18:28:24 2022] GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 18:28:24.829315 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-0e5c3d81-24b8-480b-baeb-d7bce76e08ad tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:28:24.831742 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-0e5c3d81-24b8-480b-baeb-d7bce76e08ad tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] [instance: 0308fa68-38a8-43e2-8e64-6de4f4a28f73] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:28:24.837010 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-0e5c3d81-24b8-480b-baeb-d7bce76e08ad tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:28:24.837429 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-0e5c3d81-24b8-480b-baeb-d7bce76e08ad tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:28:24.838214 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-0e5c3d81-24b8-480b-baeb-d7bce76e08ad tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:28:24.838645 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-0e5c3d81-24b8-480b-baeb-d7bce76e08ad tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:28:24.913203 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.wsgi [None req-0e5c3d81-24b8-480b-baeb-d7bce76e08ad tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] HTTP exception thrown: Instance 0308fa68-38a8-43e2-8e64-6de4f4a28f73 is not attached to volume d4ab8163-df2b-4910-bf6b-e245f054e3ed Jul 28 18:28:24.915517 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-0e5c3d81-24b8-480b-baeb-d7bce76e08ad tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Request method failure captured: Jul 28 18:28:24.915517 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: request: DELETE /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73/os-volume_attachments/d4ab8163-df2b-4910-bf6b-e245f054e3ed HTTP/1.1 Jul 28 18:28:24.915517 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Accept: application/json Jul 28 18:28:24.915517 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Accept-Encoding: identity Jul 28 18:28:24.915517 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Connection: close Jul 28 18:28:24.915517 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Content-Length: 0 Jul 28 18:28:24.915517 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Content-Type: application/json Jul 28 18:28:24.915517 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Host: 10.222.0.86 Jul 28 18:28:24.915517 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Openstack-System-Scope: None Jul 28 18:28:24.915517 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: User-Agent: python-urllib3/1.26.10 Jul 28 18:28:24.915517 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Auth-Token: gAAAAABi4tR1zx1pU5CSt3cp_VKwRmwoFvzCYmMgCqAVYryORyL3vmTrMVaSv8BayDEWUbLlwfiLHFuL-FXvUlvQq6iy_okuoZgyLSZoYFIDQgseZ0wqQJN8zR4JxTW5pi8dNLWEAG9EZElOzEzXTP-z-7R5_0t8aLsXfkHwqiftJEV1LXkfQbE Jul 28 18:28:24.915517 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Domain-Id: None Jul 28 18:28:24.915517 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Domain-Name: None Jul 28 18:28:24.915517 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Identity-Status: Confirmed Jul 28 18:28:24.915517 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Is-Admin-Project: True Jul 28 18:28:24.915517 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Domain-Id: default Jul 28 18:28:24.915517 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Domain-Name: Default Jul 28 18:28:24.915517 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Id: fe865ae79cfc41c1a2668f91e8cf0f70 Jul 28 18:28:24.915517 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Name: tempest-TestMinimumBasicScenario-1155612502 Jul 28 18:28:24.915517 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Role: member,reader Jul 28 18:28:24.915517 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Roles: member,reader Jul 28 18:28:24.917445 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_fe865ae79cfc41c1a2668f91e8cf0f70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/fe865ae79cfc41c1a2668f91e8cf0f70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/fe865ae79cfc41c1a2668f91e8cf0f70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/fe865ae79cfc41c1a2668f91e8cf0f70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}] Jul 28 18:28:24.917445 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant: tempest-TestMinimumBasicScenario-1155612502 Jul 28 18:28:24.917445 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant-Id: fe865ae79cfc41c1a2668f91e8cf0f70 Jul 28 18:28:24.917445 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1155612502 Jul 28 18:28:24.917445 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User: tempest-TestMinimumBasicScenario-1155612502-project Jul 28 18:28:24.917445 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Domain-Id: default Jul 28 18:28:24.917445 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Domain-Name: Default Jul 28 18:28:24.917445 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Id: 799a2726f3694d39a70cbdaed5257751 Jul 28 18:28:24.917445 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Name: tempest-TestMinimumBasicScenario-1155612502-project Jul 28 18:28:24.917445 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: method: > Jul 28 18:28:24.917445 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: exception: Instance 0308fa68-38a8-43e2-8e64-6de4f4a28f73 is not attached to volume d4ab8163-df2b-4910-bf6b-e245f054e3ed Jul 28 18:28:24.918478 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: action_args: {'server_id': '0308fa68-38a8-43e2-8e64-6de4f4a28f73', 'id': 'd4ab8163-df2b-4910-bf6b-e245f054e3ed'} Jul 28 18:28:24.918478 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:28:24.918478 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:28:24.918478 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 28 18:28:24.918478 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 28 18:28:24.918478 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 18:28:24.918478 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 18:28:24.918478 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 28 18:28:24.918478 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 28 18:28:24.918478 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d4ab8163-df2b-4910-bf6b-e245f054e3ed. Jul 28 18:28:24.918478 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:28:24.918478 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:28:24.918478 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:28:24.918478 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:28:24.918478 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:28:24.918478 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:28:24.918478 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:28:24.918478 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:28:24.918478 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:28:24.920078 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:28:24.920078 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 28 18:28:24.920078 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 28 18:28:24.920078 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0308fa68-38a8-43e2-8e64-6de4f4a28f73 is not attached to volume d4ab8163-df2b-4910-bf6b-e245f054e3ed Jul 28 18:28:24.920078 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:28:24.920078 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:28:24.920078 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:28:24.920078 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:28:24.920078 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:28:24.920078 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:28:24.920078 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:28:24.920078 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:28:24.920078 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0308fa68-38a8-43e2-8e64-6de4f4a28f73 is not attached to volume d4ab8163-df2b-4910-bf6b-e245f054e3ed Jul 28 18:28:24.920078 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:28:24.920078 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-0e5c3d81-24b8-480b-baeb-d7bce76e08ad tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Returning 404 to user: Instance 0308fa68-38a8-43e2-8e64-6de4f4a28f73 is not attached to volume d4ab8163-df2b-4910-bf6b-e245f054e3ed {{(pid=118454) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:28:24.921512 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-0e5c3d81-24b8-480b-baeb-d7bce76e08ad tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] 10.222.0.86 "DELETE /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73/os-volume_attachments/d4ab8163-df2b-4910-bf6b-e245f054e3ed" status: 404 len: 154 microversion: 2.1 time: 0.091934 Jul 28 18:28:24.921512 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 639/1273] 10.222.0.86 () {58 vars in 1416 bytes} [Thu Jul 28 18:28:24 2022] DELETE /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73/os-volume_attachments/d4ab8163-df2b-4910-bf6b-e245f054e3ed => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:28:26.171840 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-fbc8511a-58b9-4b99-8e8e-3cce0891e226 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:28:26.172349 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-fbc8511a-58b9-4b99-8e8e-3cce0891e226 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] [instance: 0308fa68-38a8-43e2-8e64-6de4f4a28f73] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:28:26.178886 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fbc8511a-58b9-4b99-8e8e-3cce0891e226 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:28:26.179340 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fbc8511a-58b9-4b99-8e8e-3cce0891e226 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:28:26.180100 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fbc8511a-58b9-4b99-8e8e-3cce0891e226 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:28:26.180543 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fbc8511a-58b9-4b99-8e8e-3cce0891e226 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:28:26.205782 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-fbc8511a-58b9-4b99-8e8e-3cce0891e226 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] [instance: 0308fa68-38a8-43e2-8e64-6de4f4a28f73] Going to try to terminate instance {{(pid=118453) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 18:28:26.473640 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-fbc8511a-58b9-4b99-8e8e-3cce0891e226 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] 10.222.0.86 "DELETE /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73" status: 204 len: 0 microversion: 2.1 time: 0.305258 Jul 28 18:28:26.474232 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 635/1274] 10.222.0.86 () {58 vars in 1239 bytes} [Thu Jul 28 18:28:26 2022] DELETE /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 18:28:26.482366 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-c4cc6031-fc34-4f95-b55e-5bd1c3b5f373 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:28:26.485345 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-c4cc6031-fc34-4f95-b55e-5bd1c3b5f373 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] [instance: 0308fa68-38a8-43e2-8e64-6de4f4a28f73] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:28:26.489547 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c4cc6031-fc34-4f95-b55e-5bd1c3b5f373 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:28:26.490000 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c4cc6031-fc34-4f95-b55e-5bd1c3b5f373 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:28:26.490767 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c4cc6031-fc34-4f95-b55e-5bd1c3b5f373 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:28:26.491209 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-c4cc6031-fc34-4f95-b55e-5bd1c3b5f373 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:28:26.621941 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-c4cc6031-fc34-4f95-b55e-5bd1c3b5f373 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799a2726f3694d39a70cbdaed5257751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe865ae79cfc41c1a2668f91e8cf0f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:28:26.629477 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-c4cc6031-fc34-4f95-b55e-5bd1c3b5f373 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] 10.222.0.86 "GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73" status: 200 len: 1554 microversion: 2.1 time: 0.150925 Jul 28 18:28:26.630040 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 640/1275] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:28:26 2022] GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73 => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:28:27.651076 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-fc7d0118-39d5-4e15-acc5-521bc3e3f8f3 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:28:27.651703 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-fc7d0118-39d5-4e15-acc5-521bc3e3f8f3 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] [instance: 0308fa68-38a8-43e2-8e64-6de4f4a28f73] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:28:27.658465 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fc7d0118-39d5-4e15-acc5-521bc3e3f8f3 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:28:27.658912 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fc7d0118-39d5-4e15-acc5-521bc3e3f8f3 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:28:27.659671 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fc7d0118-39d5-4e15-acc5-521bc3e3f8f3 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:28:27.660119 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-fc7d0118-39d5-4e15-acc5-521bc3e3f8f3 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:28:27.792949 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-fc7d0118-39d5-4e15-acc5-521bc3e3f8f3 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799a2726f3694d39a70cbdaed5257751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe865ae79cfc41c1a2668f91e8cf0f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:28:27.800475 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-fc7d0118-39d5-4e15-acc5-521bc3e3f8f3 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] 10.222.0.86 "GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73" status: 200 len: 1554 microversion: 2.1 time: 0.154355 Jul 28 18:28:27.801055 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 636/1276] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:28:27 2022] GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73 => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:28:28.822384 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-73555e63-0560-4278-93af-10cc618ff415 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:28:28.822958 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-73555e63-0560-4278-93af-10cc618ff415 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] [instance: 0308fa68-38a8-43e2-8e64-6de4f4a28f73] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:28:28.829634 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-73555e63-0560-4278-93af-10cc618ff415 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:28:28.830088 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-73555e63-0560-4278-93af-10cc618ff415 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:28:28.831115 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-73555e63-0560-4278-93af-10cc618ff415 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:28:28.831561 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-73555e63-0560-4278-93af-10cc618ff415 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:28:28.963295 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-73555e63-0560-4278-93af-10cc618ff415 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799a2726f3694d39a70cbdaed5257751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe865ae79cfc41c1a2668f91e8cf0f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:28:28.970942 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-73555e63-0560-4278-93af-10cc618ff415 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] 10.222.0.86 "GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73" status: 200 len: 1554 microversion: 2.1 time: 0.153263 Jul 28 18:28:28.971513 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 641/1277] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:28:28 2022] GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73 => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:28:29.390408 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-7d26983c-3fe3-4f81-b3ca-54e9a06b4682 req-acd914d5-675d-4c8b-b9b5-c3213aeaf92f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0308fa68-38a8-43e2-8e64-6de4f4a28f73", "name": "network-vif-deleted", "tag": "fffe897d-12c2-45ef-b241-0a4c420fa5f6"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:28:29.401124 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-7d26983c-3fe3-4f81-b3ca-54e9a06b4682 req-acd914d5-675d-4c8b-b9b5-c3213aeaf92f service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:28:29.402400 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-7d26983c-3fe3-4f81-b3ca-54e9a06b4682 req-acd914d5-675d-4c8b-b9b5-c3213aeaf92f service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:28:29.412514 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-7d26983c-3fe3-4f81-b3ca-54e9a06b4682 req-acd914d5-675d-4c8b-b9b5-c3213aeaf92f service nova] Creating event network-vif-deleted:fffe897d-12c2-45ef-b241-0a4c420fa5f6 for instance 0308fa68-38a8-43e2-8e64-6de4f4a28f73 on hv-cinder-84617 Jul 28 18:28:29.418480 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-7d26983c-3fe3-4f81-b3ca-54e9a06b4682 req-acd914d5-675d-4c8b-b9b5-c3213aeaf92f service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031850 Jul 28 18:28:29.419735 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 637/1278] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:28:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:28:29.992785 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-7f5a65fb-98c8-49cc-b733-03b0b6b9532c tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:28:29.993363 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-7f5a65fb-98c8-49cc-b733-03b0b6b9532c tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] [instance: 0308fa68-38a8-43e2-8e64-6de4f4a28f73] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:28:30.000187 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-7f5a65fb-98c8-49cc-b733-03b0b6b9532c tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:28:30.000627 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-7f5a65fb-98c8-49cc-b733-03b0b6b9532c tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:28:30.001412 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-7f5a65fb-98c8-49cc-b733-03b0b6b9532c tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:28:30.001843 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-7f5a65fb-98c8-49cc-b733-03b0b6b9532c tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:28:30.031886 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-7f5a65fb-98c8-49cc-b733-03b0b6b9532c tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:28:30.032327 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-7f5a65fb-98c8-49cc-b733-03b0b6b9532c tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:28:30.041380 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.objects.instance [None req-7f5a65fb-98c8-49cc-b733-03b0b6b9532c tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lazy-loading 'fault' on Instance uuid 0308fa68-38a8-43e2-8e64-6de4f4a28f73 {{(pid=118454) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:28:30.083259 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-7f5a65fb-98c8-49cc-b733-03b0b6b9532c tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799a2726f3694d39a70cbdaed5257751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe865ae79cfc41c1a2668f91e8cf0f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:28:30.091822 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-7f5a65fb-98c8-49cc-b733-03b0b6b9532c tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] 10.222.0.86 "GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73" status: 200 len: 1348 microversion: 2.1 time: 0.102956 Jul 28 18:28:30.092471 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 642/1279] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:28:29 2022] GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73 => generated 1348 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:28:31.115386 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-9e306a30-e590-413b-99ce-9243c4563b13 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:28:31.118175 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-9e306a30-e590-413b-99ce-9243c4563b13 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] [instance: 0308fa68-38a8-43e2-8e64-6de4f4a28f73] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:28:31.123189 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9e306a30-e590-413b-99ce-9243c4563b13 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:28:31.123634 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9e306a30-e590-413b-99ce-9243c4563b13 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:28:31.124394 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9e306a30-e590-413b-99ce-9243c4563b13 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:28:31.124833 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9e306a30-e590-413b-99ce-9243c4563b13 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:28:31.140158 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.wsgi [None req-9e306a30-e590-413b-99ce-9243c4563b13 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] HTTP exception thrown: Instance 0308fa68-38a8-43e2-8e64-6de4f4a28f73 could not be found. Jul 28 18:28:31.141805 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-9e306a30-e590-413b-99ce-9243c4563b13 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Request method failure captured: Jul 28 18:28:31.141805 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: request: GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73 HTTP/1.1 Jul 28 18:28:31.141805 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Accept: application/json Jul 28 18:28:31.141805 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Accept-Encoding: identity Jul 28 18:28:31.141805 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Connection: close Jul 28 18:28:31.141805 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Content-Length: 0 Jul 28 18:28:31.141805 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Content-Type: application/json Jul 28 18:28:31.141805 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Host: 10.222.0.86 Jul 28 18:28:31.141805 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Openstack-System-Scope: None Jul 28 18:28:31.141805 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: User-Agent: python-urllib3/1.26.10 Jul 28 18:28:31.141805 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Auth-Token: gAAAAABi4tR1zx1pU5CSt3cp_VKwRmwoFvzCYmMgCqAVYryORyL3vmTrMVaSv8BayDEWUbLlwfiLHFuL-FXvUlvQq6iy_okuoZgyLSZoYFIDQgseZ0wqQJN8zR4JxTW5pi8dNLWEAG9EZElOzEzXTP-z-7R5_0t8aLsXfkHwqiftJEV1LXkfQbE Jul 28 18:28:31.141805 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Domain-Id: None Jul 28 18:28:31.141805 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Domain-Name: None Jul 28 18:28:31.141805 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Identity-Status: Confirmed Jul 28 18:28:31.141805 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Is-Admin-Project: True Jul 28 18:28:31.141805 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Id: default Jul 28 18:28:31.141805 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Name: Default Jul 28 18:28:31.141805 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Id: fe865ae79cfc41c1a2668f91e8cf0f70 Jul 28 18:28:31.141805 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Name: tempest-TestMinimumBasicScenario-1155612502 Jul 28 18:28:31.141805 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Role: member,reader Jul 28 18:28:31.141805 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Roles: member,reader Jul 28 18:28:31.143701 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_fe865ae79cfc41c1a2668f91e8cf0f70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/fe865ae79cfc41c1a2668f91e8cf0f70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/fe865ae79cfc41c1a2668f91e8cf0f70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/fe865ae79cfc41c1a2668f91e8cf0f70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}] Jul 28 18:28:31.143701 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant: tempest-TestMinimumBasicScenario-1155612502 Jul 28 18:28:31.143701 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant-Id: fe865ae79cfc41c1a2668f91e8cf0f70 Jul 28 18:28:31.143701 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1155612502 Jul 28 18:28:31.143701 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User: tempest-TestMinimumBasicScenario-1155612502-project Jul 28 18:28:31.143701 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Id: default Jul 28 18:28:31.143701 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Name: Default Jul 28 18:28:31.143701 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Id: 799a2726f3694d39a70cbdaed5257751 Jul 28 18:28:31.143701 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Name: tempest-TestMinimumBasicScenario-1155612502-project Jul 28 18:28:31.143701 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: method: > Jul 28 18:28:31.143701 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: exception: Instance 0308fa68-38a8-43e2-8e64-6de4f4a28f73 could not be found. Jul 28 18:28:31.143701 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: action_args: {'id': '0308fa68-38a8-43e2-8e64-6de4f4a28f73'} Jul 28 18:28:31.144830 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:28:31.144830 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:28:31.144830 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:28:31.144830 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:28:31.144830 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:28:31.144830 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:28:31.144830 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:28:31.144830 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:28:31.144830 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:28:31.144830 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:28:31.144830 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0308fa68-38a8-43e2-8e64-6de4f4a28f73 could not be found. Jul 28 18:28:31.144830 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:28:31.144830 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:28:31.144830 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:28:31.144830 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:28:31.144830 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:28:31.144830 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:28:31.144830 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:28:31.144830 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:28:31.144830 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:28:31.146864 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:28:31.146864 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 18:28:31.146864 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 18:28:31.146864 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:28:31.146864 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:28:31.146864 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:28:31.146864 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:28:31.146864 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0308fa68-38a8-43e2-8e64-6de4f4a28f73 could not be found. Jul 28 18:28:31.146864 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:28:31.146864 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:28:31.146864 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:28:31.146864 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:28:31.146864 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:28:31.146864 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:28:31.146864 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:28:31.146864 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:28:31.146864 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0308fa68-38a8-43e2-8e64-6de4f4a28f73 could not be found. Jul 28 18:28:31.146864 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:28:31.149144 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-9e306a30-e590-413b-99ce-9243c4563b13 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Returning 404 to user: Instance 0308fa68-38a8-43e2-8e64-6de4f4a28f73 could not be found. {{(pid=118453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:28:31.149144 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-9e306a30-e590-413b-99ce-9243c4563b13 tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] 10.222.0.86 "GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73" status: 404 len: 111 microversion: 2.1 time: 0.032111 Jul 28 18:28:31.149144 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 638/1280] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:28:31 2022] GET /compute/v2.1/servers/0308fa68-38a8-43e2-8e64-6de4f4a28f73 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:28:31.152347 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-54d88d96-6fe0-4ab5-8cd8-652d3638c68c tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] Calling method '.version_select at 0x7f6fe24a4280>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:28:31.234028 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-54d88d96-6fe0-4ab5-8cd8-652d3638c68c tempest-TestMinimumBasicScenario-1155612502 tempest-TestMinimumBasicScenario-1155612502-project] 10.222.0.86 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1882398696" status: 202 len: 0 microversion: 2.1 time: 0.085926 Jul 28 18:28:31.234607 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 643/1281] 10.222.0.86 () {58 vars in 1272 bytes} [Thu Jul 28 18:28:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1882398696 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 18:29:28.451072 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-8200f0ec-7880-4234-87c5-56c349257ad7 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:29:28.451605 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-8200f0ec-7880-4234-87c5-56c349257ad7 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:29:28.454649 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:29:28.455326 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=44,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:29:28.460176 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8200f0ec-7880-4234-87c5-56c349257ad7 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:29:28.479574 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8200f0ec-7880-4234-87c5-56c349257ad7 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:29:28.479574 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8200f0ec-7880-4234-87c5-56c349257ad7 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:29:28.479574 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8200f0ec-7880-4234-87c5-56c349257ad7 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:29:28.484706 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-8200f0ec-7880-4234-87c5-56c349257ad7 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3/ips" status: 200 len: 151 microversion: 2.1 time: 0.037494 Jul 28 18:29:28.485286 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 639/1282] 10.222.0.86 () {58 vars in 1248 bytes} [Thu Jul 28 18:29:28 2022] GET /compute/v2.1/servers/d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:29:30.110495 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell1:SELECT=65 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:29:30.111353 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_api:SELECT=28,nova_api:DELETE=1 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:29:30.115540 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-39e4d07b-0635-472e-91f4-f54d42ae8997 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4f782896-ce30-47ee-8822-01a3a495df59"}} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:29:30.117897 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-39e4d07b-0635-472e-91f4-f54d42ae8997 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:29:30.125055 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-39e4d07b-0635-472e-91f4-f54d42ae8997 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:29:30.125524 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-39e4d07b-0635-472e-91f4-f54d42ae8997 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:29:30.126292 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-39e4d07b-0635-472e-91f4-f54d42ae8997 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:29:30.126731 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-39e4d07b-0635-472e-91f4-f54d42ae8997 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:29:30.801760 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-39e4d07b-0635-472e-91f4-f54d42ae8997 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "POST /compute/v2.1/servers/d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.692583 Jul 28 18:29:30.802408 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 644/1283] 10.222.0.86 () {60 vars in 1323 bytes} [Thu Jul 28 18:29:30 2022] POST /compute/v2.1/servers/d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3/os-volume_attachments => generated 194 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:29:38.418156 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a0644349-5ff9-46f0-b518-062d6fbc7a85 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:29:38.418706 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-a0644349-5ff9-46f0-b518-062d6fbc7a85 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:29:38.427676 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a0644349-5ff9-46f0-b518-062d6fbc7a85 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:29:38.428115 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a0644349-5ff9-46f0-b518-062d6fbc7a85 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:29:38.428889 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a0644349-5ff9-46f0-b518-062d6fbc7a85 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:29:38.429358 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a0644349-5ff9-46f0-b518-062d6fbc7a85 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:29:38.512077 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.objects.instance [None req-a0644349-5ff9-46f0-b518-062d6fbc7a85 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lazy-loading 'services' on Instance uuid d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3 {{(pid=118453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:29:38.716298 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-a0644349-5ff9-46f0-b518-062d6fbc7a85 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "DELETE /compute/v2.1/servers/d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3/os-volume_attachments/4f782896-ce30-47ee-8822-01a3a495df59" status: 202 len: 0 microversion: 2.1 time: 0.301940 Jul 28 18:29:38.716915 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 640/1284] 10.222.0.86 () {58 vars in 1416 bytes} [Thu Jul 28 18:29:38 2022] DELETE /compute/v2.1/servers/d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3/os-volume_attachments/4f782896-ce30-47ee-8822-01a3a495df59 => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 18:29:38.731245 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-a776bf0f-a477-49e9-913e-401ba394aa3a tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:29:38.733938 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-a776bf0f-a477-49e9-913e-401ba394aa3a tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:29:38.740912 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a776bf0f-a477-49e9-913e-401ba394aa3a tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:29:38.741388 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a776bf0f-a477-49e9-913e-401ba394aa3a tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:29:38.742184 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a776bf0f-a477-49e9-913e-401ba394aa3a tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:29:38.742592 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-a776bf0f-a477-49e9-913e-401ba394aa3a tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:29:38.772919 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-a776bf0f-a477-49e9-913e-401ba394aa3a tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050739 Jul 28 18:29:38.773473 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 645/1285] 10.222.0.86 () {58 vars in 1302 bytes} [Thu Jul 28 18:29:38 2022] GET /compute/v2.1/servers/d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:29:39.786388 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d3f3ffc9-1c26-4ac4-88f4-1ba8930f6e2b tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:29:39.788617 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-d3f3ffc9-1c26-4ac4-88f4-1ba8930f6e2b tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:29:39.796113 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d3f3ffc9-1c26-4ac4-88f4-1ba8930f6e2b tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:29:39.796579 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d3f3ffc9-1c26-4ac4-88f4-1ba8930f6e2b tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:29:39.797384 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d3f3ffc9-1c26-4ac4-88f4-1ba8930f6e2b tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:29:39.797831 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d3f3ffc9-1c26-4ac4-88f4-1ba8930f6e2b tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:29:39.828044 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-d3f3ffc9-1c26-4ac4-88f4-1ba8930f6e2b tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047084 Jul 28 18:29:39.829696 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 641/1286] 10.222.0.86 () {58 vars in 1302 bytes} [Thu Jul 28 18:29:39 2022] GET /compute/v2.1/servers/d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 18:29:39.891278 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-d37a1285-71ca-417f-bca7-a0714f212c04 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:29:39.892485 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-d37a1285-71ca-417f-bca7-a0714f212c04 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:29:39.899087 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d37a1285-71ca-417f-bca7-a0714f212c04 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:29:39.899546 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d37a1285-71ca-417f-bca7-a0714f212c04 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:29:39.900574 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d37a1285-71ca-417f-bca7-a0714f212c04 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:29:39.901054 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d37a1285-71ca-417f-bca7-a0714f212c04 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:29:39.925675 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-d37a1285-71ca-417f-bca7-a0714f212c04 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3] Going to try to terminate instance {{(pid=118454) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 18:29:40.157485 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-d37a1285-71ca-417f-bca7-a0714f212c04 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "DELETE /compute/v2.1/servers/d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3" status: 204 len: 0 microversion: 2.1 time: 0.269828 Jul 28 18:29:40.158122 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 646/1287] 10.222.0.86 () {58 vars in 1239 bytes} [Thu Jul 28 18:29:39 2022] DELETE /compute/v2.1/servers/d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 18:29:40.166371 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-863bba4b-5f23-4f1a-bf62-034ad414200d tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:29:40.167062 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-863bba4b-5f23-4f1a-bf62-034ad414200d tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:29:40.174130 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-863bba4b-5f23-4f1a-bf62-034ad414200d tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:29:40.174581 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-863bba4b-5f23-4f1a-bf62-034ad414200d tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:29:40.175348 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-863bba4b-5f23-4f1a-bf62-034ad414200d tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:29:40.175835 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-863bba4b-5f23-4f1a-bf62-034ad414200d tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:29:40.312179 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-863bba4b-5f23-4f1a-bf62-034ad414200d tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:29:40.320683 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-863bba4b-5f23-4f1a-bf62-034ad414200d tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3" status: 200 len: 1683 microversion: 2.1 time: 0.158344 Jul 28 18:29:40.321281 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 642/1288] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:29:40 2022] GET /compute/v2.1/servers/d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:29:41.342507 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-803ff382-0087-43c3-b4a1-d1cf6257535f tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:29:41.343198 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-803ff382-0087-43c3-b4a1-d1cf6257535f tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:29:41.350219 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-803ff382-0087-43c3-b4a1-d1cf6257535f tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:29:41.350671 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-803ff382-0087-43c3-b4a1-d1cf6257535f tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:29:41.351428 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-803ff382-0087-43c3-b4a1-d1cf6257535f tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:29:41.351860 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-803ff382-0087-43c3-b4a1-d1cf6257535f tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:29:41.481023 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-803ff382-0087-43c3-b4a1-d1cf6257535f tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:29:41.489054 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-803ff382-0087-43c3-b4a1-d1cf6257535f tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3" status: 200 len: 1683 microversion: 2.1 time: 0.150725 Jul 28 18:29:41.489612 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 647/1289] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:29:41 2022] GET /compute/v2.1/servers/d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3 => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:29:42.509996 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a49425a9-4a85-42be-9e75-952d4448dd12 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:29:42.511549 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-a49425a9-4a85-42be-9e75-952d4448dd12 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:29:42.519236 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a49425a9-4a85-42be-9e75-952d4448dd12 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:29:42.519685 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a49425a9-4a85-42be-9e75-952d4448dd12 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:29:42.520611 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a49425a9-4a85-42be-9e75-952d4448dd12 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:29:42.521239 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a49425a9-4a85-42be-9e75-952d4448dd12 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:29:42.651215 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-a49425a9-4a85-42be-9e75-952d4448dd12 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:29:42.658675 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-a49425a9-4a85-42be-9e75-952d4448dd12 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3" status: 200 len: 1683 microversion: 2.1 time: 0.152698 Jul 28 18:29:42.659254 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 643/1290] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:29:42 2022] GET /compute/v2.1/servers/d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:29:43.305964 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [req-8130a512-cdfd-4cb6-913b-82ba619ea296 req-5696cbb8-4489-4f20-997e-a5791d41b6cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3", "name": "network-vif-deleted", "tag": "41469e01-6c85-42ff-801f-a96fa20eb490"}]} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:29:43.316628 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-8130a512-cdfd-4cb6-913b-82ba619ea296 req-5696cbb8-4489-4f20-997e-a5791d41b6cb service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:29:43.317128 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-8130a512-cdfd-4cb6-913b-82ba619ea296 req-5696cbb8-4489-4f20-997e-a5791d41b6cb service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:29:43.330381 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.compute.server_external_events [req-8130a512-cdfd-4cb6-913b-82ba619ea296 req-5696cbb8-4489-4f20-997e-a5791d41b6cb service nova] Creating event network-vif-deleted:41469e01-6c85-42ff-801f-a96fa20eb490 for instance d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3 on hv-cinder-84617 Jul 28 18:29:43.335185 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [req-8130a512-cdfd-4cb6-913b-82ba619ea296 req-5696cbb8-4489-4f20-997e-a5791d41b6cb service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.248633 Jul 28 18:29:43.336179 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 648/1291] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:29:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:29:43.679749 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-db00584d-9a40-41a0-9c20-d52f95884be4 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:29:43.680367 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-db00584d-9a40-41a0-9c20-d52f95884be4 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:29:43.686788 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-db00584d-9a40-41a0-9c20-d52f95884be4 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:29:43.687239 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-db00584d-9a40-41a0-9c20-d52f95884be4 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:29:43.687997 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-db00584d-9a40-41a0-9c20-d52f95884be4 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:29:43.688932 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-db00584d-9a40-41a0-9c20-d52f95884be4 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:29:43.721867 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-db00584d-9a40-41a0-9c20-d52f95884be4 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:29:43.722330 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-db00584d-9a40-41a0-9c20-d52f95884be4 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:29:43.722799 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.objects.instance [None req-db00584d-9a40-41a0-9c20-d52f95884be4 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lazy-loading 'fault' on Instance uuid d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3 {{(pid=118453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:29:43.768629 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-db00584d-9a40-41a0-9c20-d52f95884be4 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b1f1c4bb2747e0845cdc2991e53b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104313ce72c94ea68c8cd3ee7f0cab2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:29:43.776335 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-db00584d-9a40-41a0-9c20-d52f95884be4 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3" status: 200 len: 1331 microversion: 2.1 time: 0.100366 Jul 28 18:29:43.777184 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 644/1292] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:29:43 2022] GET /compute/v2.1/servers/d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3 => generated 1331 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:29:44.799435 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-5a77849b-92ba-437b-a060-2476430aa4e2 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:29:44.800058 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-5a77849b-92ba-437b-a060-2476430aa4e2 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:29:44.806413 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-5a77849b-92ba-437b-a060-2476430aa4e2 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:29:44.811042 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-5a77849b-92ba-437b-a060-2476430aa4e2 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:29:44.811042 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-5a77849b-92ba-437b-a060-2476430aa4e2 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:29:44.811042 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-5a77849b-92ba-437b-a060-2476430aa4e2 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:29:44.821976 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.wsgi [None req-5a77849b-92ba-437b-a060-2476430aa4e2 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] HTTP exception thrown: Instance d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3 could not be found. Jul 28 18:29:44.823672 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-5a77849b-92ba-437b-a060-2476430aa4e2 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Request method failure captured: Jul 28 18:29:44.823672 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: request: GET /compute/v2.1/servers/d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3 HTTP/1.1 Jul 28 18:29:44.823672 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Accept: application/json Jul 28 18:29:44.823672 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Accept-Encoding: identity Jul 28 18:29:44.823672 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Connection: close Jul 28 18:29:44.823672 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Content-Length: 0 Jul 28 18:29:44.823672 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Content-Type: application/json Jul 28 18:29:44.823672 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Host: 10.222.0.86 Jul 28 18:29:44.823672 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Openstack-System-Scope: None Jul 28 18:29:44.823672 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: User-Agent: python-urllib3/1.26.10 Jul 28 18:29:44.823672 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Auth-Token: gAAAAABi4tOBTGRF9y9OAlefXy84t2lwOcq7Yp99X6H1ahc3ofs3Ehb5kBGF_9CYSBI80Rx8VFnnn80tQOz0U481VovOm_qAsLcyBFR5gizgfkClDfG1sybWskPJqHUNFOgadZvxg94hprAbcyZjmqgKLYfGkC4nDrgrf7oV07qvZWjTmYx3f6M Jul 28 18:29:44.823672 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Domain-Id: None Jul 28 18:29:44.823672 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Domain-Name: None Jul 28 18:29:44.823672 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Identity-Status: Confirmed Jul 28 18:29:44.823672 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Is-Admin-Project: True Jul 28 18:29:44.823672 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Domain-Id: default Jul 28 18:29:44.823672 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Domain-Name: Default Jul 28 18:29:44.823672 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Id: 104313ce72c94ea68c8cd3ee7f0cab2e Jul 28 18:29:44.823672 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Name: tempest-AttachVolumeNegativeTest-908754065 Jul 28 18:29:44.823672 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Role: member,reader Jul 28 18:29:44.823672 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Roles: member,reader Jul 28 18:29:44.825508 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_104313ce72c94ea68c8cd3ee7f0cab2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/104313ce72c94ea68c8cd3ee7f0cab2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/104313ce72c94ea68c8cd3ee7f0cab2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/104313ce72c94ea68c8cd3ee7f0cab2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}] Jul 28 18:29:44.825508 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant: tempest-AttachVolumeNegativeTest-908754065 Jul 28 18:29:44.825508 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant-Id: 104313ce72c94ea68c8cd3ee7f0cab2e Jul 28 18:29:44.825508 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-908754065 Jul 28 18:29:44.825508 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User: tempest-AttachVolumeNegativeTest-908754065-project Jul 28 18:29:44.825508 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Domain-Id: default Jul 28 18:29:44.825508 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Domain-Name: Default Jul 28 18:29:44.825508 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Id: e2b1f1c4bb2747e0845cdc2991e53b09 Jul 28 18:29:44.825508 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Name: tempest-AttachVolumeNegativeTest-908754065-project Jul 28 18:29:44.825508 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: method: > Jul 28 18:29:44.825508 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: exception: Instance d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3 could not be found. Jul 28 18:29:44.825508 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: action_args: {'id': 'd1bd7d9b-748b-4ff4-b29f-57a5b7b360d3'} Jul 28 18:29:44.826554 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:29:44.826554 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:29:44.826554 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:29:44.826554 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:29:44.826554 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:29:44.826554 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:29:44.826554 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:29:44.826554 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:29:44.826554 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:29:44.826554 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:29:44.826554 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3 could not be found. Jul 28 18:29:44.826554 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:29:44.826554 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:29:44.826554 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:29:44.826554 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:29:44.826554 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:29:44.826554 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:29:44.826554 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:29:44.826554 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:29:44.826554 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:29:44.828697 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:29:44.828697 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 18:29:44.828697 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 18:29:44.828697 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:29:44.828697 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:29:44.828697 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:29:44.828697 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:29:44.828697 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3 could not be found. Jul 28 18:29:44.828697 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:29:44.828697 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:29:44.828697 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:29:44.828697 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:29:44.828697 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:29:44.828697 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:29:44.828697 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:29:44.828697 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:29:44.828697 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3 could not be found. Jul 28 18:29:44.828697 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:29:44.830437 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-5a77849b-92ba-437b-a060-2476430aa4e2 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Returning 404 to user: Instance d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3 could not be found. {{(pid=118454) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:29:44.830437 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-5a77849b-92ba-437b-a060-2476430aa4e2 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3" status: 404 len: 111 microversion: 2.1 time: 0.030941 Jul 28 18:29:44.830437 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 649/1293] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:29:44 2022] GET /compute/v2.1/servers/d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:29:44.834506 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-26dcaceb-c331-4844-8326-27200e64825b tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '.version_select at 0x7f6fe1ff2af0>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:29:44.917474 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-26dcaceb-c331-4844-8326-27200e64825b tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1827072790" status: 202 len: 0 microversion: 2.1 time: 0.086700 Jul 28 18:29:44.918055 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 645/1294] 10.222.0.86 () {58 vars in 1221 bytes} [Thu Jul 28 18:29:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1827072790 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 18:29:46.879326 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-d013b53f-0f90-46a4-97a7-72dd1ca23165 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:29:46.879877 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-d013b53f-0f90-46a4-97a7-72dd1ca23165 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:29:46.886336 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d013b53f-0f90-46a4-97a7-72dd1ca23165 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:29:46.888990 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d013b53f-0f90-46a4-97a7-72dd1ca23165 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:29:46.888990 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d013b53f-0f90-46a4-97a7-72dd1ca23165 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:29:46.888990 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d013b53f-0f90-46a4-97a7-72dd1ca23165 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:29:46.903130 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.wsgi [None req-d013b53f-0f90-46a4-97a7-72dd1ca23165 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] HTTP exception thrown: Instance d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3 could not be found. Jul 28 18:29:46.904672 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-d013b53f-0f90-46a4-97a7-72dd1ca23165 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Request method failure captured: Jul 28 18:29:46.904672 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: request: DELETE /compute/v2.1/servers/d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3 HTTP/1.1 Jul 28 18:29:46.904672 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Accept: application/json Jul 28 18:29:46.904672 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Accept-Encoding: identity Jul 28 18:29:46.904672 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Connection: close Jul 28 18:29:46.904672 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Content-Length: 0 Jul 28 18:29:46.904672 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Content-Type: application/json Jul 28 18:29:46.904672 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Host: 10.222.0.86 Jul 28 18:29:46.904672 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Openstack-System-Scope: None Jul 28 18:29:46.904672 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: User-Agent: python-urllib3/1.26.10 Jul 28 18:29:46.904672 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Auth-Token: gAAAAABi4tOBTGRF9y9OAlefXy84t2lwOcq7Yp99X6H1ahc3ofs3Ehb5kBGF_9CYSBI80Rx8VFnnn80tQOz0U481VovOm_qAsLcyBFR5gizgfkClDfG1sybWskPJqHUNFOgadZvxg94hprAbcyZjmqgKLYfGkC4nDrgrf7oV07qvZWjTmYx3f6M Jul 28 18:29:46.904672 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Domain-Id: None Jul 28 18:29:46.904672 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Domain-Name: None Jul 28 18:29:46.904672 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Identity-Status: Confirmed Jul 28 18:29:46.904672 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Is-Admin-Project: True Jul 28 18:29:46.904672 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Domain-Id: default Jul 28 18:29:46.904672 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Domain-Name: Default Jul 28 18:29:46.904672 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Id: 104313ce72c94ea68c8cd3ee7f0cab2e Jul 28 18:29:46.904672 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Name: tempest-AttachVolumeNegativeTest-908754065 Jul 28 18:29:46.904672 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Role: member,reader Jul 28 18:29:46.904672 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Roles: member,reader Jul 28 18:29:46.906181 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_104313ce72c94ea68c8cd3ee7f0cab2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/104313ce72c94ea68c8cd3ee7f0cab2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/104313ce72c94ea68c8cd3ee7f0cab2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/104313ce72c94ea68c8cd3ee7f0cab2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}] Jul 28 18:29:46.906181 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant: tempest-AttachVolumeNegativeTest-908754065 Jul 28 18:29:46.906181 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant-Id: 104313ce72c94ea68c8cd3ee7f0cab2e Jul 28 18:29:46.906181 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-908754065 Jul 28 18:29:46.906181 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User: tempest-AttachVolumeNegativeTest-908754065-project Jul 28 18:29:46.906181 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Domain-Id: default Jul 28 18:29:46.906181 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Domain-Name: Default Jul 28 18:29:46.906181 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Id: e2b1f1c4bb2747e0845cdc2991e53b09 Jul 28 18:29:46.906181 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Name: tempest-AttachVolumeNegativeTest-908754065-project Jul 28 18:29:46.906181 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: method: > Jul 28 18:29:46.906181 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: exception: Instance d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3 could not be found. Jul 28 18:29:46.906181 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: action_args: {'id': 'd1bd7d9b-748b-4ff4-b29f-57a5b7b360d3'} Jul 28 18:29:46.907075 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:29:46.907075 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:29:46.907075 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:29:46.907075 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:29:46.907075 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:29:46.907075 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:29:46.907075 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:29:46.907075 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:29:46.907075 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:29:46.907075 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:29:46.907075 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3 could not be found. Jul 28 18:29:46.907075 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:29:46.907075 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:29:46.907075 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:29:46.907075 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:29:46.907075 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:29:46.907075 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:29:46.907075 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:29:46.907075 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:29:46.907075 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:29:46.909203 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:29:46.909203 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 18:29:46.909203 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 18:29:46.909203 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 18:29:46.909203 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 18:29:46.909203 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:29:46.909203 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:29:46.909203 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:29:46.909203 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:29:46.909203 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3 could not be found. Jul 28 18:29:46.909203 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:29:46.909203 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:29:46.909203 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:29:46.909203 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:29:46.909203 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:29:46.909203 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:29:46.909203 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:29:46.909203 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:29:46.909203 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3 could not be found. Jul 28 18:29:46.909203 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:29:46.910779 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-d013b53f-0f90-46a4-97a7-72dd1ca23165 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Returning 404 to user: Instance d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3 could not be found. {{(pid=118454) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:29:46.910779 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-d013b53f-0f90-46a4-97a7-72dd1ca23165 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "DELETE /compute/v2.1/servers/d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3" status: 404 len: 111 microversion: 2.1 time: 0.031214 Jul 28 18:29:46.910779 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 650/1295] 10.222.0.86 () {58 vars in 1239 bytes} [Thu Jul 28 18:29:46 2022] DELETE /compute/v2.1/servers/d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:29:46.915078 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a40ad632-1741-4b5a-98e6-8ab0d0826258 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:29:46.915695 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-a40ad632-1741-4b5a-98e6-8ab0d0826258 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:29:46.922356 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a40ad632-1741-4b5a-98e6-8ab0d0826258 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:29:46.922810 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a40ad632-1741-4b5a-98e6-8ab0d0826258 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:29:46.923581 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a40ad632-1741-4b5a-98e6-8ab0d0826258 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:29:46.924032 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a40ad632-1741-4b5a-98e6-8ab0d0826258 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:29:46.939181 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.wsgi [None req-a40ad632-1741-4b5a-98e6-8ab0d0826258 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] HTTP exception thrown: Instance d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3 could not be found. Jul 28 18:29:46.940811 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a40ad632-1741-4b5a-98e6-8ab0d0826258 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Request method failure captured: Jul 28 18:29:46.940811 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: request: GET /compute/v2.1/servers/d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3 HTTP/1.1 Jul 28 18:29:46.940811 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Accept: application/json Jul 28 18:29:46.940811 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Accept-Encoding: identity Jul 28 18:29:46.940811 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Connection: close Jul 28 18:29:46.940811 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Content-Length: 0 Jul 28 18:29:46.940811 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Content-Type: application/json Jul 28 18:29:46.940811 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Host: 10.222.0.86 Jul 28 18:29:46.940811 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Openstack-System-Scope: None Jul 28 18:29:46.940811 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: User-Agent: python-urllib3/1.26.10 Jul 28 18:29:46.940811 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Auth-Token: gAAAAABi4tOBTGRF9y9OAlefXy84t2lwOcq7Yp99X6H1ahc3ofs3Ehb5kBGF_9CYSBI80Rx8VFnnn80tQOz0U481VovOm_qAsLcyBFR5gizgfkClDfG1sybWskPJqHUNFOgadZvxg94hprAbcyZjmqgKLYfGkC4nDrgrf7oV07qvZWjTmYx3f6M Jul 28 18:29:46.940811 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Domain-Id: None Jul 28 18:29:46.940811 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Domain-Name: None Jul 28 18:29:46.940811 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Identity-Status: Confirmed Jul 28 18:29:46.940811 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Is-Admin-Project: True Jul 28 18:29:46.940811 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Id: default Jul 28 18:29:46.940811 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Name: Default Jul 28 18:29:46.940811 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Id: 104313ce72c94ea68c8cd3ee7f0cab2e Jul 28 18:29:46.940811 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Name: tempest-AttachVolumeNegativeTest-908754065 Jul 28 18:29:46.940811 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Role: member,reader Jul 28 18:29:46.940811 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Roles: member,reader Jul 28 18:29:46.942591 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_104313ce72c94ea68c8cd3ee7f0cab2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/104313ce72c94ea68c8cd3ee7f0cab2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/104313ce72c94ea68c8cd3ee7f0cab2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/104313ce72c94ea68c8cd3ee7f0cab2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}] Jul 28 18:29:46.942591 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant: tempest-AttachVolumeNegativeTest-908754065 Jul 28 18:29:46.942591 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant-Id: 104313ce72c94ea68c8cd3ee7f0cab2e Jul 28 18:29:46.942591 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-908754065 Jul 28 18:29:46.942591 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User: tempest-AttachVolumeNegativeTest-908754065-project Jul 28 18:29:46.942591 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Id: default Jul 28 18:29:46.942591 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Name: Default Jul 28 18:29:46.942591 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Id: e2b1f1c4bb2747e0845cdc2991e53b09 Jul 28 18:29:46.942591 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Name: tempest-AttachVolumeNegativeTest-908754065-project Jul 28 18:29:46.942591 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: method: > Jul 28 18:29:46.942591 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: exception: Instance d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3 could not be found. Jul 28 18:29:46.942591 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: action_args: {'id': 'd1bd7d9b-748b-4ff4-b29f-57a5b7b360d3'} Jul 28 18:29:46.943847 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:29:46.943847 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:29:46.943847 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:29:46.943847 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:29:46.943847 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:29:46.943847 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:29:46.943847 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:29:46.943847 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:29:46.943847 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:29:46.943847 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:29:46.943847 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3 could not be found. Jul 28 18:29:46.943847 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:29:46.943847 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:29:46.943847 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:29:46.943847 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:29:46.943847 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:29:46.943847 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:29:46.943847 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:29:46.943847 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:29:46.943847 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:29:46.945523 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:29:46.945523 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 18:29:46.945523 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 18:29:46.945523 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:29:46.945523 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:29:46.945523 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:29:46.945523 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:29:46.945523 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3 could not be found. Jul 28 18:29:46.945523 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:29:46.945523 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:29:46.945523 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:29:46.945523 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:29:46.945523 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:29:46.945523 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:29:46.945523 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:29:46.945523 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:29:46.945523 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3 could not be found. Jul 28 18:29:46.945523 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:29:46.946974 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a40ad632-1741-4b5a-98e6-8ab0d0826258 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Returning 404 to user: Instance d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3 could not be found. {{(pid=118453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:29:46.946974 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-a40ad632-1741-4b5a-98e6-8ab0d0826258 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3" status: 404 len: 111 microversion: 2.1 time: 0.031511 Jul 28 18:29:46.946974 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 646/1296] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:29:46 2022] GET /compute/v2.1/servers/d1bd7d9b-748b-4ff4-b29f-57a5b7b360d3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:29:48.201604 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-916f6bfd-2df1-4d60-8ec3-a9fa29b5ae02 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:29:48.202095 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-916f6bfd-2df1-4d60-8ec3-a9fa29b5ae02 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: c06cd5e6-1268-409e-9b59-2f29f39d1404] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:29:48.209456 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-916f6bfd-2df1-4d60-8ec3-a9fa29b5ae02 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:29:48.209908 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-916f6bfd-2df1-4d60-8ec3-a9fa29b5ae02 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:29:48.210671 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-916f6bfd-2df1-4d60-8ec3-a9fa29b5ae02 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:29:48.211106 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-916f6bfd-2df1-4d60-8ec3-a9fa29b5ae02 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:29:48.224124 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.wsgi [None req-916f6bfd-2df1-4d60-8ec3-a9fa29b5ae02 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] HTTP exception thrown: Instance c06cd5e6-1268-409e-9b59-2f29f39d1404 could not be found. Jul 28 18:29:48.225687 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-916f6bfd-2df1-4d60-8ec3-a9fa29b5ae02 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Request method failure captured: Jul 28 18:29:48.225687 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: request: DELETE /compute/v2.1/servers/c06cd5e6-1268-409e-9b59-2f29f39d1404 HTTP/1.1 Jul 28 18:29:48.225687 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Accept: application/json Jul 28 18:29:48.225687 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Accept-Encoding: identity Jul 28 18:29:48.225687 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Connection: close Jul 28 18:29:48.225687 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Content-Length: 0 Jul 28 18:29:48.225687 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Content-Type: application/json Jul 28 18:29:48.225687 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Host: 10.222.0.86 Jul 28 18:29:48.225687 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Openstack-System-Scope: None Jul 28 18:29:48.225687 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: User-Agent: python-urllib3/1.26.10 Jul 28 18:29:48.225687 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Auth-Token: gAAAAABi4tOBTGRF9y9OAlefXy84t2lwOcq7Yp99X6H1ahc3ofs3Ehb5kBGF_9CYSBI80Rx8VFnnn80tQOz0U481VovOm_qAsLcyBFR5gizgfkClDfG1sybWskPJqHUNFOgadZvxg94hprAbcyZjmqgKLYfGkC4nDrgrf7oV07qvZWjTmYx3f6M Jul 28 18:29:48.225687 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Domain-Id: None Jul 28 18:29:48.225687 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Domain-Name: None Jul 28 18:29:48.225687 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Identity-Status: Confirmed Jul 28 18:29:48.225687 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Is-Admin-Project: True Jul 28 18:29:48.225687 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Domain-Id: default Jul 28 18:29:48.225687 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Domain-Name: Default Jul 28 18:29:48.225687 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Id: 104313ce72c94ea68c8cd3ee7f0cab2e Jul 28 18:29:48.225687 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Name: tempest-AttachVolumeNegativeTest-908754065 Jul 28 18:29:48.225687 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Role: member,reader Jul 28 18:29:48.225687 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Roles: member,reader Jul 28 18:29:48.227426 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_104313ce72c94ea68c8cd3ee7f0cab2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/104313ce72c94ea68c8cd3ee7f0cab2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/104313ce72c94ea68c8cd3ee7f0cab2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/104313ce72c94ea68c8cd3ee7f0cab2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}] Jul 28 18:29:48.227426 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant: tempest-AttachVolumeNegativeTest-908754065 Jul 28 18:29:48.227426 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant-Id: 104313ce72c94ea68c8cd3ee7f0cab2e Jul 28 18:29:48.227426 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-908754065 Jul 28 18:29:48.227426 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User: tempest-AttachVolumeNegativeTest-908754065-project Jul 28 18:29:48.227426 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Domain-Id: default Jul 28 18:29:48.227426 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Domain-Name: Default Jul 28 18:29:48.227426 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Id: e2b1f1c4bb2747e0845cdc2991e53b09 Jul 28 18:29:48.227426 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Name: tempest-AttachVolumeNegativeTest-908754065-project Jul 28 18:29:48.227426 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: method: > Jul 28 18:29:48.227426 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: exception: Instance c06cd5e6-1268-409e-9b59-2f29f39d1404 could not be found. Jul 28 18:29:48.227426 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: action_args: {'id': 'c06cd5e6-1268-409e-9b59-2f29f39d1404'} Jul 28 18:29:48.228272 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:29:48.228272 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:29:48.228272 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:29:48.228272 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:29:48.228272 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:29:48.228272 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:29:48.228272 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:29:48.228272 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:29:48.228272 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:29:48.228272 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:29:48.228272 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c06cd5e6-1268-409e-9b59-2f29f39d1404 could not be found. Jul 28 18:29:48.228272 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:29:48.228272 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:29:48.228272 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:29:48.228272 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:29:48.228272 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:29:48.228272 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:29:48.228272 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:29:48.228272 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:29:48.228272 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:29:48.229657 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:29:48.229657 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 18:29:48.229657 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 18:29:48.229657 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 18:29:48.229657 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 18:29:48.229657 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:29:48.229657 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:29:48.229657 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:29:48.229657 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:29:48.229657 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c06cd5e6-1268-409e-9b59-2f29f39d1404 could not be found. Jul 28 18:29:48.229657 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:29:48.229657 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:29:48.229657 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:29:48.229657 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:29:48.229657 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:29:48.229657 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:29:48.229657 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:29:48.229657 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:29:48.229657 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c06cd5e6-1268-409e-9b59-2f29f39d1404 could not be found. Jul 28 18:29:48.229657 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:29:48.231042 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-916f6bfd-2df1-4d60-8ec3-a9fa29b5ae02 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Returning 404 to user: Instance c06cd5e6-1268-409e-9b59-2f29f39d1404 could not be found. {{(pid=118454) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:29:48.231042 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-916f6bfd-2df1-4d60-8ec3-a9fa29b5ae02 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "DELETE /compute/v2.1/servers/c06cd5e6-1268-409e-9b59-2f29f39d1404" status: 404 len: 111 microversion: 2.1 time: 0.029485 Jul 28 18:29:48.231042 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 651/1297] 10.222.0.86 () {58 vars in 1239 bytes} [Thu Jul 28 18:29:48 2022] DELETE /compute/v2.1/servers/c06cd5e6-1268-409e-9b59-2f29f39d1404 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:29:48.235662 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-dd1bbaef-0107-439d-85ba-05ee7db0c6ae tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:29:48.236281 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-dd1bbaef-0107-439d-85ba-05ee7db0c6ae tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: c06cd5e6-1268-409e-9b59-2f29f39d1404] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:29:48.242886 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dd1bbaef-0107-439d-85ba-05ee7db0c6ae tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:29:48.243341 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dd1bbaef-0107-439d-85ba-05ee7db0c6ae tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:29:48.244112 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dd1bbaef-0107-439d-85ba-05ee7db0c6ae tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:29:48.244556 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-dd1bbaef-0107-439d-85ba-05ee7db0c6ae tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:29:48.261421 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.wsgi [None req-dd1bbaef-0107-439d-85ba-05ee7db0c6ae tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] HTTP exception thrown: Instance c06cd5e6-1268-409e-9b59-2f29f39d1404 could not be found. Jul 28 18:29:48.263727 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-dd1bbaef-0107-439d-85ba-05ee7db0c6ae tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Request method failure captured: Jul 28 18:29:48.263727 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: request: GET /compute/v2.1/servers/c06cd5e6-1268-409e-9b59-2f29f39d1404 HTTP/1.1 Jul 28 18:29:48.263727 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Accept: application/json Jul 28 18:29:48.263727 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Accept-Encoding: identity Jul 28 18:29:48.263727 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Connection: close Jul 28 18:29:48.263727 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Content-Length: 0 Jul 28 18:29:48.263727 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Content-Type: application/json Jul 28 18:29:48.263727 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Host: 10.222.0.86 Jul 28 18:29:48.263727 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Openstack-System-Scope: None Jul 28 18:29:48.263727 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: User-Agent: python-urllib3/1.26.10 Jul 28 18:29:48.263727 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Auth-Token: gAAAAABi4tOBTGRF9y9OAlefXy84t2lwOcq7Yp99X6H1ahc3ofs3Ehb5kBGF_9CYSBI80Rx8VFnnn80tQOz0U481VovOm_qAsLcyBFR5gizgfkClDfG1sybWskPJqHUNFOgadZvxg94hprAbcyZjmqgKLYfGkC4nDrgrf7oV07qvZWjTmYx3f6M Jul 28 18:29:48.263727 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Domain-Id: None Jul 28 18:29:48.263727 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Domain-Name: None Jul 28 18:29:48.263727 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Identity-Status: Confirmed Jul 28 18:29:48.263727 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Is-Admin-Project: True Jul 28 18:29:48.263727 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Id: default Jul 28 18:29:48.263727 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Name: Default Jul 28 18:29:48.263727 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Id: 104313ce72c94ea68c8cd3ee7f0cab2e Jul 28 18:29:48.263727 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Name: tempest-AttachVolumeNegativeTest-908754065 Jul 28 18:29:48.263727 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Role: member,reader Jul 28 18:29:48.263727 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Roles: member,reader Jul 28 18:29:48.265786 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_104313ce72c94ea68c8cd3ee7f0cab2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/104313ce72c94ea68c8cd3ee7f0cab2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/104313ce72c94ea68c8cd3ee7f0cab2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/104313ce72c94ea68c8cd3ee7f0cab2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}] Jul 28 18:29:48.265786 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant: tempest-AttachVolumeNegativeTest-908754065 Jul 28 18:29:48.265786 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant-Id: 104313ce72c94ea68c8cd3ee7f0cab2e Jul 28 18:29:48.265786 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-908754065 Jul 28 18:29:48.265786 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User: tempest-AttachVolumeNegativeTest-908754065-project Jul 28 18:29:48.265786 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Id: default Jul 28 18:29:48.265786 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Name: Default Jul 28 18:29:48.265786 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Id: e2b1f1c4bb2747e0845cdc2991e53b09 Jul 28 18:29:48.265786 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Name: tempest-AttachVolumeNegativeTest-908754065-project Jul 28 18:29:48.265786 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: method: > Jul 28 18:29:48.265786 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: exception: Instance c06cd5e6-1268-409e-9b59-2f29f39d1404 could not be found. Jul 28 18:29:48.265786 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: action_args: {'id': 'c06cd5e6-1268-409e-9b59-2f29f39d1404'} Jul 28 18:29:48.267635 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:29:48.267635 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:29:48.267635 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:29:48.267635 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:29:48.267635 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:29:48.267635 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:29:48.267635 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:29:48.267635 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:29:48.267635 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:29:48.267635 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:29:48.267635 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c06cd5e6-1268-409e-9b59-2f29f39d1404 could not be found. Jul 28 18:29:48.267635 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:29:48.267635 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:29:48.267635 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:29:48.267635 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:29:48.267635 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:29:48.267635 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:29:48.267635 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:29:48.267635 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:29:48.267635 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:29:48.269534 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:29:48.269534 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 18:29:48.269534 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 18:29:48.269534 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:29:48.269534 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:29:48.269534 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:29:48.269534 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:29:48.269534 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c06cd5e6-1268-409e-9b59-2f29f39d1404 could not be found. Jul 28 18:29:48.269534 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:29:48.269534 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:29:48.269534 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:29:48.269534 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:29:48.269534 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:29:48.269534 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:29:48.269534 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:29:48.269534 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:29:48.269534 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c06cd5e6-1268-409e-9b59-2f29f39d1404 could not be found. Jul 28 18:29:48.269534 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:29:48.270964 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-dd1bbaef-0107-439d-85ba-05ee7db0c6ae tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Returning 404 to user: Instance c06cd5e6-1268-409e-9b59-2f29f39d1404 could not be found. {{(pid=118453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:29:48.270964 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-dd1bbaef-0107-439d-85ba-05ee7db0c6ae tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/c06cd5e6-1268-409e-9b59-2f29f39d1404" status: 404 len: 111 microversion: 2.1 time: 0.034091 Jul 28 18:29:48.270964 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 647/1298] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:29:48 2022] GET /compute/v2.1/servers/c06cd5e6-1268-409e-9b59-2f29f39d1404 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:29:48.275589 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-099427b0-ef66-4d85-a7fb-176a1e274e21 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:29:48.276095 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-099427b0-ef66-4d85-a7fb-176a1e274e21 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: f7a41dc5-d258-475a-a1c1-9aad0723d5cb] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:29:48.283199 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-099427b0-ef66-4d85-a7fb-176a1e274e21 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:29:48.283877 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-099427b0-ef66-4d85-a7fb-176a1e274e21 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:29:48.285077 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-099427b0-ef66-4d85-a7fb-176a1e274e21 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:29:48.285761 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-099427b0-ef66-4d85-a7fb-176a1e274e21 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:29:48.300751 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.wsgi [None req-099427b0-ef66-4d85-a7fb-176a1e274e21 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] HTTP exception thrown: Instance f7a41dc5-d258-475a-a1c1-9aad0723d5cb could not be found. Jul 28 18:29:48.302328 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-099427b0-ef66-4d85-a7fb-176a1e274e21 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Request method failure captured: Jul 28 18:29:48.302328 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: request: DELETE /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb HTTP/1.1 Jul 28 18:29:48.302328 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Accept: application/json Jul 28 18:29:48.302328 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Accept-Encoding: identity Jul 28 18:29:48.302328 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Connection: close Jul 28 18:29:48.302328 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Content-Length: 0 Jul 28 18:29:48.302328 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Content-Type: application/json Jul 28 18:29:48.302328 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Host: 10.222.0.86 Jul 28 18:29:48.302328 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Openstack-System-Scope: None Jul 28 18:29:48.302328 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: User-Agent: python-urllib3/1.26.10 Jul 28 18:29:48.302328 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Auth-Token: gAAAAABi4tOBTGRF9y9OAlefXy84t2lwOcq7Yp99X6H1ahc3ofs3Ehb5kBGF_9CYSBI80Rx8VFnnn80tQOz0U481VovOm_qAsLcyBFR5gizgfkClDfG1sybWskPJqHUNFOgadZvxg94hprAbcyZjmqgKLYfGkC4nDrgrf7oV07qvZWjTmYx3f6M Jul 28 18:29:48.302328 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Domain-Id: None Jul 28 18:29:48.302328 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Domain-Name: None Jul 28 18:29:48.302328 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Identity-Status: Confirmed Jul 28 18:29:48.302328 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Is-Admin-Project: True Jul 28 18:29:48.302328 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Domain-Id: default Jul 28 18:29:48.302328 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Domain-Name: Default Jul 28 18:29:48.302328 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Id: 104313ce72c94ea68c8cd3ee7f0cab2e Jul 28 18:29:48.302328 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Name: tempest-AttachVolumeNegativeTest-908754065 Jul 28 18:29:48.302328 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Role: member,reader Jul 28 18:29:48.302328 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Roles: member,reader Jul 28 18:29:48.304310 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_104313ce72c94ea68c8cd3ee7f0cab2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/104313ce72c94ea68c8cd3ee7f0cab2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/104313ce72c94ea68c8cd3ee7f0cab2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/104313ce72c94ea68c8cd3ee7f0cab2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}] Jul 28 18:29:48.304310 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant: tempest-AttachVolumeNegativeTest-908754065 Jul 28 18:29:48.304310 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant-Id: 104313ce72c94ea68c8cd3ee7f0cab2e Jul 28 18:29:48.304310 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-908754065 Jul 28 18:29:48.304310 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User: tempest-AttachVolumeNegativeTest-908754065-project Jul 28 18:29:48.304310 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Domain-Id: default Jul 28 18:29:48.304310 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Domain-Name: Default Jul 28 18:29:48.304310 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Id: e2b1f1c4bb2747e0845cdc2991e53b09 Jul 28 18:29:48.304310 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Name: tempest-AttachVolumeNegativeTest-908754065-project Jul 28 18:29:48.304310 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: method: > Jul 28 18:29:48.304310 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: exception: Instance f7a41dc5-d258-475a-a1c1-9aad0723d5cb could not be found. Jul 28 18:29:48.304310 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: action_args: {'id': 'f7a41dc5-d258-475a-a1c1-9aad0723d5cb'} Jul 28 18:29:48.305347 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:29:48.305347 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:29:48.305347 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:29:48.305347 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:29:48.305347 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:29:48.305347 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:29:48.305347 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:29:48.305347 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:29:48.305347 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:29:48.305347 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:29:48.305347 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7a41dc5-d258-475a-a1c1-9aad0723d5cb could not be found. Jul 28 18:29:48.305347 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:29:48.305347 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:29:48.305347 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:29:48.305347 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:29:48.305347 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:29:48.305347 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:29:48.305347 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:29:48.305347 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:29:48.305347 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:29:48.306977 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:29:48.306977 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 18:29:48.306977 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 18:29:48.306977 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 18:29:48.306977 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 18:29:48.306977 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:29:48.306977 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:29:48.306977 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:29:48.306977 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:29:48.306977 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7a41dc5-d258-475a-a1c1-9aad0723d5cb could not be found. Jul 28 18:29:48.306977 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:29:48.306977 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:29:48.306977 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:29:48.306977 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:29:48.306977 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:29:48.306977 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:29:48.306977 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:29:48.306977 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:29:48.306977 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7a41dc5-d258-475a-a1c1-9aad0723d5cb could not be found. Jul 28 18:29:48.306977 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:29:48.308865 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-099427b0-ef66-4d85-a7fb-176a1e274e21 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Returning 404 to user: Instance f7a41dc5-d258-475a-a1c1-9aad0723d5cb could not be found. {{(pid=118454) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:29:48.308865 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-099427b0-ef66-4d85-a7fb-176a1e274e21 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "DELETE /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb" status: 404 len: 111 microversion: 2.1 time: 0.032205 Jul 28 18:29:48.308865 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 652/1299] 10.222.0.86 () {58 vars in 1239 bytes} [Thu Jul 28 18:29:48 2022] DELETE /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:29:48.312278 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-8a615a3b-868d-49b6-9cb8-fac77c37120e tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:29:48.313404 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-8a615a3b-868d-49b6-9cb8-fac77c37120e tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: f7a41dc5-d258-475a-a1c1-9aad0723d5cb] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:29:48.319595 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8a615a3b-868d-49b6-9cb8-fac77c37120e tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:29:48.320090 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8a615a3b-868d-49b6-9cb8-fac77c37120e tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:29:48.320895 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8a615a3b-868d-49b6-9cb8-fac77c37120e tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:29:48.321383 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8a615a3b-868d-49b6-9cb8-fac77c37120e tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:29:48.335785 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.wsgi [None req-8a615a3b-868d-49b6-9cb8-fac77c37120e tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] HTTP exception thrown: Instance f7a41dc5-d258-475a-a1c1-9aad0723d5cb could not be found. Jul 28 18:29:48.337346 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-8a615a3b-868d-49b6-9cb8-fac77c37120e tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Request method failure captured: Jul 28 18:29:48.337346 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: request: GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb HTTP/1.1 Jul 28 18:29:48.337346 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Accept: application/json Jul 28 18:29:48.337346 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Accept-Encoding: identity Jul 28 18:29:48.337346 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Connection: close Jul 28 18:29:48.337346 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Content-Length: 0 Jul 28 18:29:48.337346 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Content-Type: application/json Jul 28 18:29:48.337346 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Host: 10.222.0.86 Jul 28 18:29:48.337346 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Openstack-System-Scope: None Jul 28 18:29:48.337346 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: User-Agent: python-urllib3/1.26.10 Jul 28 18:29:48.337346 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Auth-Token: gAAAAABi4tOBTGRF9y9OAlefXy84t2lwOcq7Yp99X6H1ahc3ofs3Ehb5kBGF_9CYSBI80Rx8VFnnn80tQOz0U481VovOm_qAsLcyBFR5gizgfkClDfG1sybWskPJqHUNFOgadZvxg94hprAbcyZjmqgKLYfGkC4nDrgrf7oV07qvZWjTmYx3f6M Jul 28 18:29:48.337346 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Domain-Id: None Jul 28 18:29:48.337346 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Domain-Name: None Jul 28 18:29:48.337346 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Identity-Status: Confirmed Jul 28 18:29:48.337346 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Is-Admin-Project: True Jul 28 18:29:48.337346 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Id: default Jul 28 18:29:48.337346 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Name: Default Jul 28 18:29:48.337346 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Id: 104313ce72c94ea68c8cd3ee7f0cab2e Jul 28 18:29:48.337346 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Name: tempest-AttachVolumeNegativeTest-908754065 Jul 28 18:29:48.337346 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Role: member,reader Jul 28 18:29:48.337346 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Roles: member,reader Jul 28 18:29:48.339118 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_104313ce72c94ea68c8cd3ee7f0cab2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/104313ce72c94ea68c8cd3ee7f0cab2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/104313ce72c94ea68c8cd3ee7f0cab2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/104313ce72c94ea68c8cd3ee7f0cab2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}] Jul 28 18:29:48.339118 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant: tempest-AttachVolumeNegativeTest-908754065 Jul 28 18:29:48.339118 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant-Id: 104313ce72c94ea68c8cd3ee7f0cab2e Jul 28 18:29:48.339118 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-908754065 Jul 28 18:29:48.339118 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User: tempest-AttachVolumeNegativeTest-908754065-project Jul 28 18:29:48.339118 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Id: default Jul 28 18:29:48.339118 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Name: Default Jul 28 18:29:48.339118 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Id: e2b1f1c4bb2747e0845cdc2991e53b09 Jul 28 18:29:48.339118 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Name: tempest-AttachVolumeNegativeTest-908754065-project Jul 28 18:29:48.339118 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: method: > Jul 28 18:29:48.339118 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: exception: Instance f7a41dc5-d258-475a-a1c1-9aad0723d5cb could not be found. Jul 28 18:29:48.339118 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: action_args: {'id': 'f7a41dc5-d258-475a-a1c1-9aad0723d5cb'} Jul 28 18:29:48.340071 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:29:48.340071 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:29:48.340071 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:29:48.340071 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:29:48.340071 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:29:48.340071 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:29:48.340071 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:29:48.340071 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:29:48.340071 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:29:48.340071 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:29:48.340071 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7a41dc5-d258-475a-a1c1-9aad0723d5cb could not be found. Jul 28 18:29:48.340071 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:29:48.340071 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:29:48.340071 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:29:48.340071 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:29:48.340071 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:29:48.340071 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:29:48.340071 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:29:48.340071 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:29:48.340071 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:29:48.341694 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:29:48.341694 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 18:29:48.341694 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 18:29:48.341694 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:29:48.341694 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:29:48.341694 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:29:48.341694 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:29:48.341694 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7a41dc5-d258-475a-a1c1-9aad0723d5cb could not be found. Jul 28 18:29:48.341694 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:29:48.341694 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:29:48.341694 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:29:48.341694 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:29:48.341694 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:29:48.341694 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:29:48.341694 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:29:48.341694 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:29:48.341694 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7a41dc5-d258-475a-a1c1-9aad0723d5cb could not be found. Jul 28 18:29:48.341694 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:29:48.343114 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-8a615a3b-868d-49b6-9cb8-fac77c37120e tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Returning 404 to user: Instance f7a41dc5-d258-475a-a1c1-9aad0723d5cb could not be found. {{(pid=118453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:29:48.343114 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-8a615a3b-868d-49b6-9cb8-fac77c37120e tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb" status: 404 len: 111 microversion: 2.1 time: 0.030360 Jul 28 18:29:48.343114 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 648/1300] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:29:48 2022] GET /compute/v2.1/servers/f7a41dc5-d258-475a-a1c1-9aad0723d5cb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:29:49.601984 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-572b6cdf-42e9-4743-926e-32701e346200 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:29:49.602484 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-572b6cdf-42e9-4743-926e-32701e346200 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: 1b4d9d7f-8b12-4bfa-83a0-e55a8422d754] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:29:49.608870 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-572b6cdf-42e9-4743-926e-32701e346200 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:29:49.609351 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-572b6cdf-42e9-4743-926e-32701e346200 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:29:49.610113 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-572b6cdf-42e9-4743-926e-32701e346200 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:29:49.610549 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-572b6cdf-42e9-4743-926e-32701e346200 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:29:49.626018 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.wsgi [None req-572b6cdf-42e9-4743-926e-32701e346200 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] HTTP exception thrown: Instance 1b4d9d7f-8b12-4bfa-83a0-e55a8422d754 could not be found. Jul 28 18:29:49.627539 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-572b6cdf-42e9-4743-926e-32701e346200 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Request method failure captured: Jul 28 18:29:49.627539 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: request: DELETE /compute/v2.1/servers/1b4d9d7f-8b12-4bfa-83a0-e55a8422d754 HTTP/1.1 Jul 28 18:29:49.627539 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Accept: application/json Jul 28 18:29:49.627539 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Accept-Encoding: identity Jul 28 18:29:49.627539 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Connection: close Jul 28 18:29:49.627539 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Content-Length: 0 Jul 28 18:29:49.627539 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Content-Type: application/json Jul 28 18:29:49.627539 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Host: 10.222.0.86 Jul 28 18:29:49.627539 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Openstack-System-Scope: None Jul 28 18:29:49.627539 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: User-Agent: python-urllib3/1.26.10 Jul 28 18:29:49.627539 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Auth-Token: gAAAAABi4tOBTGRF9y9OAlefXy84t2lwOcq7Yp99X6H1ahc3ofs3Ehb5kBGF_9CYSBI80Rx8VFnnn80tQOz0U481VovOm_qAsLcyBFR5gizgfkClDfG1sybWskPJqHUNFOgadZvxg94hprAbcyZjmqgKLYfGkC4nDrgrf7oV07qvZWjTmYx3f6M Jul 28 18:29:49.627539 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Domain-Id: None Jul 28 18:29:49.627539 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Domain-Name: None Jul 28 18:29:49.627539 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Identity-Status: Confirmed Jul 28 18:29:49.627539 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Is-Admin-Project: True Jul 28 18:29:49.627539 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Domain-Id: default Jul 28 18:29:49.627539 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Domain-Name: Default Jul 28 18:29:49.627539 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Id: 104313ce72c94ea68c8cd3ee7f0cab2e Jul 28 18:29:49.627539 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Name: tempest-AttachVolumeNegativeTest-908754065 Jul 28 18:29:49.627539 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Role: member,reader Jul 28 18:29:49.627539 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Roles: member,reader Jul 28 18:29:49.629360 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_104313ce72c94ea68c8cd3ee7f0cab2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/104313ce72c94ea68c8cd3ee7f0cab2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/104313ce72c94ea68c8cd3ee7f0cab2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/104313ce72c94ea68c8cd3ee7f0cab2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}] Jul 28 18:29:49.629360 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant: tempest-AttachVolumeNegativeTest-908754065 Jul 28 18:29:49.629360 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant-Id: 104313ce72c94ea68c8cd3ee7f0cab2e Jul 28 18:29:49.629360 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-908754065 Jul 28 18:29:49.629360 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User: tempest-AttachVolumeNegativeTest-908754065-project Jul 28 18:29:49.629360 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Domain-Id: default Jul 28 18:29:49.629360 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Domain-Name: Default Jul 28 18:29:49.629360 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Id: e2b1f1c4bb2747e0845cdc2991e53b09 Jul 28 18:29:49.629360 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Name: tempest-AttachVolumeNegativeTest-908754065-project Jul 28 18:29:49.629360 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: method: > Jul 28 18:29:49.629360 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: exception: Instance 1b4d9d7f-8b12-4bfa-83a0-e55a8422d754 could not be found. Jul 28 18:29:49.629360 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: action_args: {'id': '1b4d9d7f-8b12-4bfa-83a0-e55a8422d754'} Jul 28 18:29:49.630327 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:29:49.630327 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:29:49.630327 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:29:49.630327 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:29:49.630327 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:29:49.630327 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:29:49.630327 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:29:49.630327 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:29:49.630327 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:29:49.630327 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:29:49.630327 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b4d9d7f-8b12-4bfa-83a0-e55a8422d754 could not be found. Jul 28 18:29:49.630327 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:29:49.630327 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:29:49.630327 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:29:49.630327 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:29:49.630327 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:29:49.630327 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:29:49.630327 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:29:49.630327 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:29:49.630327 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:29:49.631957 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:29:49.631957 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 18:29:49.631957 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 18:29:49.631957 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 18:29:49.631957 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 18:29:49.631957 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:29:49.631957 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:29:49.631957 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:29:49.631957 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:29:49.631957 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b4d9d7f-8b12-4bfa-83a0-e55a8422d754 could not be found. Jul 28 18:29:49.631957 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:29:49.631957 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:29:49.631957 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:29:49.631957 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:29:49.631957 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:29:49.631957 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:29:49.631957 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:29:49.631957 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:29:49.631957 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b4d9d7f-8b12-4bfa-83a0-e55a8422d754 could not be found. Jul 28 18:29:49.631957 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:29:49.634030 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-572b6cdf-42e9-4743-926e-32701e346200 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Returning 404 to user: Instance 1b4d9d7f-8b12-4bfa-83a0-e55a8422d754 could not be found. {{(pid=118454) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:29:49.634030 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-572b6cdf-42e9-4743-926e-32701e346200 tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "DELETE /compute/v2.1/servers/1b4d9d7f-8b12-4bfa-83a0-e55a8422d754" status: 404 len: 111 microversion: 2.1 time: 0.030730 Jul 28 18:29:49.634030 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 653/1301] 10.222.0.86 () {58 vars in 1239 bytes} [Thu Jul 28 18:29:49 2022] DELETE /compute/v2.1/servers/1b4d9d7f-8b12-4bfa-83a0-e55a8422d754 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:29:49.637269 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a5d8147b-f6cb-46ac-a352-c2aa18e717ee tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:29:49.637915 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-a5d8147b-f6cb-46ac-a352-c2aa18e717ee tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] [instance: 1b4d9d7f-8b12-4bfa-83a0-e55a8422d754] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:29:49.645120 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a5d8147b-f6cb-46ac-a352-c2aa18e717ee tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:29:49.645578 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a5d8147b-f6cb-46ac-a352-c2aa18e717ee tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:29:49.646354 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a5d8147b-f6cb-46ac-a352-c2aa18e717ee tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:29:49.646834 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a5d8147b-f6cb-46ac-a352-c2aa18e717ee tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:29:49.660033 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.wsgi [None req-a5d8147b-f6cb-46ac-a352-c2aa18e717ee tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] HTTP exception thrown: Instance 1b4d9d7f-8b12-4bfa-83a0-e55a8422d754 could not be found. Jul 28 18:29:49.661693 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a5d8147b-f6cb-46ac-a352-c2aa18e717ee tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Request method failure captured: Jul 28 18:29:49.661693 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: request: GET /compute/v2.1/servers/1b4d9d7f-8b12-4bfa-83a0-e55a8422d754 HTTP/1.1 Jul 28 18:29:49.661693 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Accept: application/json Jul 28 18:29:49.661693 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Accept-Encoding: identity Jul 28 18:29:49.661693 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Connection: close Jul 28 18:29:49.661693 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Content-Length: 0 Jul 28 18:29:49.661693 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Content-Type: application/json Jul 28 18:29:49.661693 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Host: 10.222.0.86 Jul 28 18:29:49.661693 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Openstack-System-Scope: None Jul 28 18:29:49.661693 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: User-Agent: python-urllib3/1.26.10 Jul 28 18:29:49.661693 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Auth-Token: gAAAAABi4tOBTGRF9y9OAlefXy84t2lwOcq7Yp99X6H1ahc3ofs3Ehb5kBGF_9CYSBI80Rx8VFnnn80tQOz0U481VovOm_qAsLcyBFR5gizgfkClDfG1sybWskPJqHUNFOgadZvxg94hprAbcyZjmqgKLYfGkC4nDrgrf7oV07qvZWjTmYx3f6M Jul 28 18:29:49.661693 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Domain-Id: None Jul 28 18:29:49.661693 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Domain-Name: None Jul 28 18:29:49.661693 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Identity-Status: Confirmed Jul 28 18:29:49.661693 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Is-Admin-Project: True Jul 28 18:29:49.661693 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Id: default Jul 28 18:29:49.661693 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Name: Default Jul 28 18:29:49.661693 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Id: 104313ce72c94ea68c8cd3ee7f0cab2e Jul 28 18:29:49.661693 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Name: tempest-AttachVolumeNegativeTest-908754065 Jul 28 18:29:49.661693 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Role: member,reader Jul 28 18:29:49.661693 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Roles: member,reader Jul 28 18:29:49.663426 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_104313ce72c94ea68c8cd3ee7f0cab2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/104313ce72c94ea68c8cd3ee7f0cab2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/104313ce72c94ea68c8cd3ee7f0cab2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/104313ce72c94ea68c8cd3ee7f0cab2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}] Jul 28 18:29:49.663426 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant: tempest-AttachVolumeNegativeTest-908754065 Jul 28 18:29:49.663426 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant-Id: 104313ce72c94ea68c8cd3ee7f0cab2e Jul 28 18:29:49.663426 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-908754065 Jul 28 18:29:49.663426 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User: tempest-AttachVolumeNegativeTest-908754065-project Jul 28 18:29:49.663426 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Id: default Jul 28 18:29:49.663426 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Name: Default Jul 28 18:29:49.663426 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Id: e2b1f1c4bb2747e0845cdc2991e53b09 Jul 28 18:29:49.663426 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Name: tempest-AttachVolumeNegativeTest-908754065-project Jul 28 18:29:49.663426 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: method: > Jul 28 18:29:49.663426 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: exception: Instance 1b4d9d7f-8b12-4bfa-83a0-e55a8422d754 could not be found. Jul 28 18:29:49.663426 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: action_args: {'id': '1b4d9d7f-8b12-4bfa-83a0-e55a8422d754'} Jul 28 18:29:49.664397 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:29:49.664397 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:29:49.664397 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:29:49.664397 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:29:49.664397 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:29:49.664397 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:29:49.664397 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:29:49.664397 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:29:49.664397 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:29:49.664397 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:29:49.664397 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b4d9d7f-8b12-4bfa-83a0-e55a8422d754 could not be found. Jul 28 18:29:49.664397 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:29:49.664397 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:29:49.664397 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:29:49.664397 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:29:49.664397 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:29:49.664397 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:29:49.664397 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:29:49.664397 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:29:49.664397 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:29:49.665997 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:29:49.665997 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 18:29:49.665997 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 18:29:49.665997 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:29:49.665997 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:29:49.665997 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:29:49.665997 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:29:49.665997 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b4d9d7f-8b12-4bfa-83a0-e55a8422d754 could not be found. Jul 28 18:29:49.665997 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:29:49.665997 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:29:49.665997 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:29:49.665997 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:29:49.665997 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:29:49.665997 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:29:49.665997 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:29:49.665997 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:29:49.665997 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b4d9d7f-8b12-4bfa-83a0-e55a8422d754 could not be found. Jul 28 18:29:49.665997 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:29:49.667534 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a5d8147b-f6cb-46ac-a352-c2aa18e717ee tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] Returning 404 to user: Instance 1b4d9d7f-8b12-4bfa-83a0-e55a8422d754 could not be found. {{(pid=118453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:29:49.667534 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-a5d8147b-f6cb-46ac-a352-c2aa18e717ee tempest-AttachVolumeNegativeTest-908754065 tempest-AttachVolumeNegativeTest-908754065-project] 10.222.0.86 "GET /compute/v2.1/servers/1b4d9d7f-8b12-4bfa-83a0-e55a8422d754" status: 404 len: 111 microversion: 2.1 time: 0.029621 Jul 28 18:29:49.667534 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 649/1302] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:29:49 2022] GET /compute/v2.1/servers/1b4d9d7f-8b12-4bfa-83a0-e55a8422d754 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:29:56.579398 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-aee0c267-8017-472c-89ff-bd9c1499b2ec tempest-VolumesTestJSON-475317735 tempest-VolumesTestJSON-475317735-project] Calling method '.version_select at 0x7f6fe26ea790>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:29:56.627336 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-aee0c267-8017-472c-89ff-bd9c1499b2ec tempest-VolumesTestJSON-475317735 tempest-VolumesTestJSON-475317735-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/95b6a5a1-fd0d-4a92-bfda-eb413d6727c6" status: 200 len: 349 microversion: 2.1 time: 0.051969 Jul 28 18:29:56.627956 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 654/1303] 10.222.0.86 () {58 vars in 1245 bytes} [Thu Jul 28 18:29:56 2022] GET /compute/v2.1/os-volumes/95b6a5a1-fd0d-4a92-bfda-eb413d6727c6 => generated 349 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 18:29:58.199543 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-367e8e08-718e-49a9-b350-5cca08e0e4ce tempest-VolumesTestJSON-475317735 tempest-VolumesTestJSON-475317735-project] Calling method '.version_select at 0x7f6fe26a6dc0>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:29:58.246659 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-367e8e08-718e-49a9-b350-5cca08e0e4ce tempest-VolumesTestJSON-475317735 tempest-VolumesTestJSON-475317735-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/7e88ee40-cdc7-4dbc-a281-eaad3e38279c" status: 200 len: 350 microversion: 2.1 time: 0.050704 Jul 28 18:29:58.247229 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 650/1304] 10.222.0.86 () {58 vars in 1245 bytes} [Thu Jul 28 18:29:58 2022] GET /compute/v2.1/os-volumes/7e88ee40-cdc7-4dbc-a281-eaad3e38279c => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:29:59.819474 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:29:59.820227 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:29:59.824064 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-23ec09e3-fe3c-47c7-8aa3-9337470700b6 tempest-VolumesTestJSON-475317735 tempest-VolumesTestJSON-475317735-project] Calling method '.version_select at 0x7f6fe23575e0>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:29:59.870968 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-23ec09e3-fe3c-47c7-8aa3-9337470700b6 tempest-VolumesTestJSON-475317735 tempest-VolumesTestJSON-475317735-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/38005dc2-a947-4269-9712-9caff7d51deb" status: 200 len: 351 microversion: 2.1 time: 0.052588 Jul 28 18:29:59.871725 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 655/1305] 10.222.0.86 () {58 vars in 1245 bytes} [Thu Jul 28 18:29:59 2022] GET /compute/v2.1/os-volumes/38005dc2-a947-4269-9712-9caff7d51deb => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:29:59.881604 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:29:59.882369 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:29:59.886151 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ce51918a-db90-4909-8b5c-63cfc6bf2bcb tempest-VolumesTestJSON-475317735 tempest-VolumesTestJSON-475317735-project] Calling method '.version_select at 0x7f6fe6b729d0>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:29:59.969398 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ce51918a-db90-4909-8b5c-63cfc6bf2bcb tempest-VolumesTestJSON-475317735 tempest-VolumesTestJSON-475317735-project] 10.222.0.86 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.089083 Jul 28 18:29:59.969955 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 651/1306] 10.222.0.86 () {58 vars in 1134 bytes} [Thu Jul 28 18:29:59 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:30:00.039262 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-f08d0881-0b52-469f-add3-7e173c68e187 tempest-VolumesTestJSON-475317735 tempest-VolumesTestJSON-475317735-project] Calling method '.version_select at 0x7f6fe2659dc0>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:30:00.122820 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-f08d0881-0b52-469f-add3-7e173c68e187 tempest-VolumesTestJSON-475317735 tempest-VolumesTestJSON-475317735-project] 10.222.0.86 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.087481 Jul 28 18:30:00.123396 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 656/1307] 10.222.0.86 () {58 vars in 1149 bytes} [Thu Jul 28 18:30:00 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:30:00.136440 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-4abdb3bd-d947-4d87-aaf6-c16e6f2062bd tempest-VolumesTestJSON-475317735 tempest-VolumesTestJSON-475317735-project] Calling method '.version_select at 0x7f6fe6b72ee0>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:30:00.220723 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-4abdb3bd-d947-4d87-aaf6-c16e6f2062bd tempest-VolumesTestJSON-475317735 tempest-VolumesTestJSON-475317735-project] 10.222.0.86 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.087766 Jul 28 18:30:00.221390 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 652/1308] 10.222.0.86 () {58 vars in 1134 bytes} [Thu Jul 28 18:30:00 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:30:00.233788 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-c75060a4-4a83-4f87-bec5-f706f1f7c069 tempest-VolumesTestJSON-475317735 tempest-VolumesTestJSON-475317735-project] Calling method '.version_select at 0x7f6fe24c5700>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:30:00.315955 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-c75060a4-4a83-4f87-bec5-f706f1f7c069 tempest-VolumesTestJSON-475317735 tempest-VolumesTestJSON-475317735-project] 10.222.0.86 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.085955 Jul 28 18:30:00.316563 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 657/1309] 10.222.0.86 () {58 vars in 1167 bytes} [Thu Jul 28 18:30:00 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:30:00.329960 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d3b35759-5d3f-4a56-bca8-44f2fd58e7d6 tempest-VolumesTestJSON-475317735 tempest-VolumesTestJSON-475317735-project] Calling method '.version_select at 0x7f6fe25a6160>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:30:00.412739 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-d3b35759-5d3f-4a56-bca8-44f2fd58e7d6 tempest-VolumesTestJSON-475317735 tempest-VolumesTestJSON-475317735-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.086842 Jul 28 18:30:00.413395 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 653/1310] 10.222.0.86 () {58 vars in 1170 bytes} [Thu Jul 28 18:30:00 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:30:00.427947 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-bfba9858-6e4d-4c7b-9a67-5e6de51c0212 tempest-VolumesTestJSON-475317735 tempest-VolumesTestJSON-475317735-project] Calling method '.version_select at 0x7f6fe2787d30>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:30:00.510845 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-bfba9858-6e4d-4c7b-9a67-5e6de51c0212 tempest-VolumesTestJSON-475317735 tempest-VolumesTestJSON-475317735-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.087243 Jul 28 18:30:00.511406 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 658/1311] 10.222.0.86 () {58 vars in 1155 bytes} [Thu Jul 28 18:30:00 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:30:00.523838 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-cd498bac-e4c2-49a3-ba9d-9da1927a213a tempest-VolumesTestJSON-475317735 tempest-VolumesTestJSON-475317735-project] Calling method '.version_select at 0x7f6fe6be0e50>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:30:00.604057 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-cd498bac-e4c2-49a3-ba9d-9da1927a213a tempest-VolumesTestJSON-475317735 tempest-VolumesTestJSON-475317735-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.083879 Jul 28 18:30:00.604666 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 654/1312] 10.222.0.86 () {58 vars in 1188 bytes} [Thu Jul 28 18:30:00 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:30:00.617663 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-90a646fc-c65a-40e9-a87d-85d763ef3f1d tempest-VolumesTestJSON-475317735 tempest-VolumesTestJSON-475317735-project] Calling method '.version_select at 0x7f6fe22e74c0>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:30:00.702106 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-90a646fc-c65a-40e9-a87d-85d763ef3f1d tempest-VolumesTestJSON-475317735 tempest-VolumesTestJSON-475317735-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.088119 Jul 28 18:30:00.702674 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 659/1313] 10.222.0.86 () {58 vars in 1155 bytes} [Thu Jul 28 18:30:00 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:30:06.573164 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-1e6c89a6-e7fd-474f-9c8d-ddc9282a7664 tempest-VolumesNegativeTest-1673716597 tempest-VolumesNegativeTest-1673716597-project] Action: 'create', calling method: .version_select at 0x7f6fe2004040>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1965771228", "metadata": {"Type": "work"}}} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:30:06.582846 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-1e6c89a6-e7fd-474f-9c8d-ddc9282a7664 tempest-VolumesNegativeTest-1673716597 tempest-VolumesNegativeTest-1673716597-project] Request method failure captured: Jul 28 18:30:06.582846 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 28 18:30:06.582846 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Accept: application/json Jul 28 18:30:06.582846 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Accept-Encoding: identity Jul 28 18:30:06.582846 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Connection: close Jul 28 18:30:06.582846 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Content-Length: 122 Jul 28 18:30:06.582846 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Content-Type: application/json Jul 28 18:30:06.582846 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Host: 10.222.0.86 Jul 28 18:30:06.582846 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Openstack-System-Scope: None Jul 28 18:30:06.582846 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: User-Agent: python-urllib3/1.26.10 Jul 28 18:30:06.582846 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Auth-Token: gAAAAABi4tWuMy0HbP4yWqCWiVB4kO8gllRHauYC6ANOHMSQ25bHsdb_hYgFvVMKuQPWiNvTew7WtC4-NtSmynCdVdw7RUD4Vv_AS7eTTM6V-aKyKEvH-q_SZFjoYKp_mRxWANao5BFbBcMdlMfrGBvKWgC3UvjS23yDlRvOdQnzzhLmG_MIQSE Jul 28 18:30:06.582846 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Domain-Id: None Jul 28 18:30:06.582846 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Domain-Name: None Jul 28 18:30:06.582846 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Identity-Status: Confirmed Jul 28 18:30:06.582846 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Is-Admin-Project: True Jul 28 18:30:06.582846 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Id: default Jul 28 18:30:06.582846 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Name: Default Jul 28 18:30:06.582846 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Id: a9db7b96f21f441bb275a26c2942a0e1 Jul 28 18:30:06.582846 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Name: tempest-VolumesNegativeTest-1673716597 Jul 28 18:30:06.582846 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Role: member,reader Jul 28 18:30:06.582846 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Roles: member,reader Jul 28 18:30:06.584714 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_a9db7b96f21f441bb275a26c2942a0e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/a9db7b96f21f441bb275a26c2942a0e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/a9db7b96f21f441bb275a26c2942a0e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/a9db7b96f21f441bb275a26c2942a0e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}] Jul 28 18:30:06.584714 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant: tempest-VolumesNegativeTest-1673716597 Jul 28 18:30:06.584714 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant-Id: a9db7b96f21f441bb275a26c2942a0e1 Jul 28 18:30:06.584714 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant-Name: tempest-VolumesNegativeTest-1673716597 Jul 28 18:30:06.584714 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User: tempest-VolumesNegativeTest-1673716597-project Jul 28 18:30:06.584714 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Id: default Jul 28 18:30:06.584714 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Name: Default Jul 28 18:30:06.584714 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Id: a44207d124074e34b0bb60fd4bc59259 Jul 28 18:30:06.584714 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Name: tempest-VolumesNegativeTest-1673716597-project Jul 28 18:30:06.584714 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Jul 28 18:30:06.584714 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1965771228", "metadata": {"Type": "work"}}} Jul 28 18:30:06.584714 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: method: Jul 28 18:30:06.584714 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 28 18:30:06.586005 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1965771228', 'metadata': {'Type': 'work'}}}} Jul 28 18:30:06.586005 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:30:06.586005 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:30:06.586005 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 18:30:06.586005 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 18:30:06.586005 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 18:30:06.586005 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise error Jul 28 18:30:06.586005 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 28 18:30:06.586005 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:30:06.586005 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 28 18:30:06.586005 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 28 18:30:06.586005 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:30:06.586005 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 28 18:30:06.586005 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi '#$%' Jul 28 18:30:06.586005 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:30:06.586005 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:30:06.586005 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:30:06.586005 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:30:06.586005 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:30:06.586005 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:30:06.586005 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:30:06.586005 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:30:06.587901 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 18:30:06.587901 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 18:30:06.587901 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:30:06.587901 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:30:06.587901 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 18:30:06.587901 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 18:30:06.587901 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 18:30:06.587901 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 18:30:06.587901 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 18:30:06.587901 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 18:30:06.587901 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 28 18:30:06.587901 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:30:06.587901 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:30:06.587901 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:30:06.587901 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:30:06.587901 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:30:06.587901 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:30:06.587901 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 18:30:06.587901 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 18:30:06.589542 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 28 18:30:06.589542 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:30:06.589542 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-1e6c89a6-e7fd-474f-9c8d-ddc9282a7664 tempest-VolumesNegativeTest-1673716597 tempest-VolumesNegativeTest-1673716597-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:30:06.589542 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-1e6c89a6-e7fd-474f-9c8d-ddc9282a7664 tempest-VolumesNegativeTest-1673716597 tempest-VolumesNegativeTest-1673716597-project] 10.222.0.86 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.124494 Jul 28 18:30:06.589542 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 655/1314] 10.222.0.86 () {60 vars in 1156 bytes} [Thu Jul 28 18:30:06 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 126 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 18:30:06.594420 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-6bbef43d-ce7d-4ef4-ae89-70bd90d5e850 tempest-VolumesNegativeTest-1673716597 tempest-VolumesNegativeTest-1673716597-project] Action: 'create', calling method: .version_select at 0x7f6fe22e79d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1228356309", "metadata": {"Type": "work"}}} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:30:06.599661 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-6bbef43d-ce7d-4ef4-ae89-70bd90d5e850 tempest-VolumesNegativeTest-1673716597 tempest-VolumesNegativeTest-1673716597-project] Request method failure captured: Jul 28 18:30:06.599661 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 28 18:30:06.599661 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Accept: application/json Jul 28 18:30:06.599661 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Accept-Encoding: identity Jul 28 18:30:06.599661 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Connection: close Jul 28 18:30:06.599661 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Content-Length: 120 Jul 28 18:30:06.599661 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Content-Type: application/json Jul 28 18:30:06.599661 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Host: 10.222.0.86 Jul 28 18:30:06.599661 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Openstack-System-Scope: None Jul 28 18:30:06.599661 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: User-Agent: python-urllib3/1.26.10 Jul 28 18:30:06.599661 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Auth-Token: gAAAAABi4tWuMy0HbP4yWqCWiVB4kO8gllRHauYC6ANOHMSQ25bHsdb_hYgFvVMKuQPWiNvTew7WtC4-NtSmynCdVdw7RUD4Vv_AS7eTTM6V-aKyKEvH-q_SZFjoYKp_mRxWANao5BFbBcMdlMfrGBvKWgC3UvjS23yDlRvOdQnzzhLmG_MIQSE Jul 28 18:30:06.599661 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Domain-Id: None Jul 28 18:30:06.599661 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Domain-Name: None Jul 28 18:30:06.599661 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Identity-Status: Confirmed Jul 28 18:30:06.599661 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Is-Admin-Project: True Jul 28 18:30:06.599661 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Domain-Id: default Jul 28 18:30:06.599661 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Domain-Name: Default Jul 28 18:30:06.599661 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Id: a9db7b96f21f441bb275a26c2942a0e1 Jul 28 18:30:06.599661 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Name: tempest-VolumesNegativeTest-1673716597 Jul 28 18:30:06.599661 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Role: member,reader Jul 28 18:30:06.599661 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Roles: member,reader Jul 28 18:30:06.601418 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_a9db7b96f21f441bb275a26c2942a0e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/a9db7b96f21f441bb275a26c2942a0e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/a9db7b96f21f441bb275a26c2942a0e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/a9db7b96f21f441bb275a26c2942a0e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}] Jul 28 18:30:06.601418 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant: tempest-VolumesNegativeTest-1673716597 Jul 28 18:30:06.601418 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant-Id: a9db7b96f21f441bb275a26c2942a0e1 Jul 28 18:30:06.601418 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant-Name: tempest-VolumesNegativeTest-1673716597 Jul 28 18:30:06.601418 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User: tempest-VolumesNegativeTest-1673716597-project Jul 28 18:30:06.601418 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Domain-Id: default Jul 28 18:30:06.601418 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Domain-Name: Default Jul 28 18:30:06.601418 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Id: a44207d124074e34b0bb60fd4bc59259 Jul 28 18:30:06.601418 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Name: tempest-VolumesNegativeTest-1673716597-project Jul 28 18:30:06.601418 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Jul 28 18:30:06.601418 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1228356309", "metadata": {"Type": "work"}}} Jul 28 18:30:06.601418 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: method: Jul 28 18:30:06.601418 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 28 18:30:06.602568 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1228356309', 'metadata': {'Type': 'work'}}}} Jul 28 18:30:06.602568 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:30:06.602568 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:30:06.602568 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 18:30:06.602568 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 18:30:06.602568 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 18:30:06.602568 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise error Jul 28 18:30:06.602568 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 28 18:30:06.602568 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:30:06.602568 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 28 18:30:06.602568 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 28 18:30:06.602568 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:30:06.602568 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 28 18:30:06.602568 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi '0' Jul 28 18:30:06.602568 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:30:06.602568 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:30:06.602568 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:30:06.602568 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:30:06.602568 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:30:06.602568 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:30:06.602568 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:30:06.602568 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:30:06.604354 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 18:30:06.604354 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 18:30:06.604354 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:30:06.604354 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:30:06.604354 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 18:30:06.604354 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 18:30:06.604354 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 18:30:06.604354 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 18:30:06.604354 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 18:30:06.604354 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 18:30:06.604354 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 28 18:30:06.604354 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:30:06.604354 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:30:06.604354 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:30:06.604354 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:30:06.604354 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:30:06.604354 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:30:06.604354 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 18:30:06.604354 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 18:30:06.605908 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 28 18:30:06.605908 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:30:06.605908 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-6bbef43d-ce7d-4ef4-ae89-70bd90d5e850 tempest-VolumesNegativeTest-1673716597 tempest-VolumesNegativeTest-1673716597-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118454) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:30:06.605908 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-6bbef43d-ce7d-4ef4-ae89-70bd90d5e850 tempest-VolumesNegativeTest-1673716597 tempest-VolumesNegativeTest-1673716597-project] 10.222.0.86 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011032 Jul 28 18:30:06.605908 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 660/1315] 10.222.0.86 () {60 vars in 1156 bytes} [Thu Jul 28 18:30:06 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 18:30:06.609716 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-c34010c0-96b4-4818-9010-4017ad0bf6dd tempest-VolumesNegativeTest-1673716597 tempest-VolumesNegativeTest-1673716597-project] Action: 'create', calling method: .version_select at 0x7f6fe6c2ca60>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-110854586", "metadata": {"Type": "work"}}} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:30:06.613818 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-c34010c0-96b4-4818-9010-4017ad0bf6dd tempest-VolumesNegativeTest-1673716597 tempest-VolumesNegativeTest-1673716597-project] Request method failure captured: Jul 28 18:30:06.613818 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 28 18:30:06.613818 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Accept: application/json Jul 28 18:30:06.613818 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Accept-Encoding: identity Jul 28 18:30:06.613818 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Connection: close Jul 28 18:30:06.613818 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Content-Length: 118 Jul 28 18:30:06.613818 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Content-Type: application/json Jul 28 18:30:06.613818 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Host: 10.222.0.86 Jul 28 18:30:06.613818 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Openstack-System-Scope: None Jul 28 18:30:06.613818 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: User-Agent: python-urllib3/1.26.10 Jul 28 18:30:06.613818 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Auth-Token: gAAAAABi4tWuMy0HbP4yWqCWiVB4kO8gllRHauYC6ANOHMSQ25bHsdb_hYgFvVMKuQPWiNvTew7WtC4-NtSmynCdVdw7RUD4Vv_AS7eTTM6V-aKyKEvH-q_SZFjoYKp_mRxWANao5BFbBcMdlMfrGBvKWgC3UvjS23yDlRvOdQnzzhLmG_MIQSE Jul 28 18:30:06.613818 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Domain-Id: None Jul 28 18:30:06.613818 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Domain-Name: None Jul 28 18:30:06.613818 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Identity-Status: Confirmed Jul 28 18:30:06.613818 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Is-Admin-Project: True Jul 28 18:30:06.613818 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Id: default Jul 28 18:30:06.613818 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Name: Default Jul 28 18:30:06.613818 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Id: a9db7b96f21f441bb275a26c2942a0e1 Jul 28 18:30:06.613818 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Name: tempest-VolumesNegativeTest-1673716597 Jul 28 18:30:06.613818 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Role: member,reader Jul 28 18:30:06.613818 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Roles: member,reader Jul 28 18:30:06.615510 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_a9db7b96f21f441bb275a26c2942a0e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/a9db7b96f21f441bb275a26c2942a0e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/a9db7b96f21f441bb275a26c2942a0e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/a9db7b96f21f441bb275a26c2942a0e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}] Jul 28 18:30:06.615510 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant: tempest-VolumesNegativeTest-1673716597 Jul 28 18:30:06.615510 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant-Id: a9db7b96f21f441bb275a26c2942a0e1 Jul 28 18:30:06.615510 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant-Name: tempest-VolumesNegativeTest-1673716597 Jul 28 18:30:06.615510 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User: tempest-VolumesNegativeTest-1673716597-project Jul 28 18:30:06.615510 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Id: default Jul 28 18:30:06.615510 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Name: Default Jul 28 18:30:06.615510 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Id: a44207d124074e34b0bb60fd4bc59259 Jul 28 18:30:06.615510 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Name: tempest-VolumesNegativeTest-1673716597-project Jul 28 18:30:06.615510 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Jul 28 18:30:06.615510 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-110854586", "metadata": {"Type": "work"}}} Jul 28 18:30:06.615510 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: method: Jul 28 18:30:06.615510 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 28 18:30:06.616570 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-110854586', 'metadata': {'Type': 'work'}}}} Jul 28 18:30:06.616570 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:30:06.616570 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:30:06.616570 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 18:30:06.616570 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 18:30:06.616570 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 18:30:06.616570 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise error Jul 28 18:30:06.616570 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 28 18:30:06.616570 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:30:06.616570 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 28 18:30:06.616570 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 28 18:30:06.616570 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:30:06.616570 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 28 18:30:06.616570 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi '' Jul 28 18:30:06.616570 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:30:06.616570 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:30:06.616570 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:30:06.616570 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:30:06.616570 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:30:06.616570 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:30:06.616570 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:30:06.616570 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:30:06.618386 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 18:30:06.618386 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 18:30:06.618386 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:30:06.618386 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:30:06.618386 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 18:30:06.618386 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 18:30:06.618386 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 18:30:06.618386 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 18:30:06.618386 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 18:30:06.618386 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 18:30:06.618386 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 28 18:30:06.618386 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:30:06.618386 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:30:06.618386 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:30:06.618386 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:30:06.618386 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:30:06.618386 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:30:06.618386 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 18:30:06.618386 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 18:30:06.619878 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 28 18:30:06.619878 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:30:06.619878 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-c34010c0-96b4-4818-9010-4017ad0bf6dd tempest-VolumesNegativeTest-1673716597 tempest-VolumesNegativeTest-1673716597-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:30:06.619878 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-c34010c0-96b4-4818-9010-4017ad0bf6dd tempest-VolumesNegativeTest-1673716597 tempest-VolumesNegativeTest-1673716597-project] 10.222.0.86 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009137 Jul 28 18:30:06.619878 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 656/1316] 10.222.0.86 () {60 vars in 1156 bytes} [Thu Jul 28 18:30:06 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 18:30:06.623798 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-a8166bd2-050f-4df2-a741-740c4e5c76aa tempest-VolumesNegativeTest-1673716597 tempest-VolumesNegativeTest-1673716597-project] Calling method '.version_select at 0x7f6fe2791ca0>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:30:06.652262 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.wsgi [None req-a8166bd2-050f-4df2-a741-740c4e5c76aa tempest-VolumesNegativeTest-1673716597 tempest-VolumesNegativeTest-1673716597-project] HTTP exception thrown: Volume tempest-invalid-409245276 could not be found. Jul 28 18:30:06.654258 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-a8166bd2-050f-4df2-a741-740c4e5c76aa tempest-VolumesNegativeTest-1673716597 tempest-VolumesNegativeTest-1673716597-project] Request method failure captured: Jul 28 18:30:06.654258 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-409245276 HTTP/1.1 Jul 28 18:30:06.654258 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Accept: application/json Jul 28 18:30:06.654258 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Accept-Encoding: identity Jul 28 18:30:06.654258 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Connection: close Jul 28 18:30:06.654258 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Content-Length: 0 Jul 28 18:30:06.654258 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Content-Type: application/json Jul 28 18:30:06.654258 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Host: 10.222.0.86 Jul 28 18:30:06.654258 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Openstack-System-Scope: None Jul 28 18:30:06.654258 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: User-Agent: python-urllib3/1.26.10 Jul 28 18:30:06.654258 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Auth-Token: gAAAAABi4tWuMy0HbP4yWqCWiVB4kO8gllRHauYC6ANOHMSQ25bHsdb_hYgFvVMKuQPWiNvTew7WtC4-NtSmynCdVdw7RUD4Vv_AS7eTTM6V-aKyKEvH-q_SZFjoYKp_mRxWANao5BFbBcMdlMfrGBvKWgC3UvjS23yDlRvOdQnzzhLmG_MIQSE Jul 28 18:30:06.654258 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Domain-Id: None Jul 28 18:30:06.654258 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Domain-Name: None Jul 28 18:30:06.654258 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Identity-Status: Confirmed Jul 28 18:30:06.654258 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Is-Admin-Project: True Jul 28 18:30:06.654258 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Domain-Id: default Jul 28 18:30:06.654258 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Domain-Name: Default Jul 28 18:30:06.654258 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Id: a9db7b96f21f441bb275a26c2942a0e1 Jul 28 18:30:06.654258 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Name: tempest-VolumesNegativeTest-1673716597 Jul 28 18:30:06.654258 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Role: member,reader Jul 28 18:30:06.654258 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Roles: member,reader Jul 28 18:30:06.655997 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_a9db7b96f21f441bb275a26c2942a0e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/a9db7b96f21f441bb275a26c2942a0e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/a9db7b96f21f441bb275a26c2942a0e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/a9db7b96f21f441bb275a26c2942a0e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}] Jul 28 18:30:06.655997 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant: tempest-VolumesNegativeTest-1673716597 Jul 28 18:30:06.655997 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant-Id: a9db7b96f21f441bb275a26c2942a0e1 Jul 28 18:30:06.655997 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant-Name: tempest-VolumesNegativeTest-1673716597 Jul 28 18:30:06.655997 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User: tempest-VolumesNegativeTest-1673716597-project Jul 28 18:30:06.655997 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Domain-Id: default Jul 28 18:30:06.655997 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Domain-Name: Default Jul 28 18:30:06.655997 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Id: a44207d124074e34b0bb60fd4bc59259 Jul 28 18:30:06.655997 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Name: tempest-VolumesNegativeTest-1673716597-project Jul 28 18:30:06.655997 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: method: Jul 28 18:30:06.655997 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: exception: Volume tempest-invalid-409245276 could not be found. Jul 28 18:30:06.655997 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: action_args: {'id': 'tempest-invalid-409245276'} Jul 28 18:30:06.655997 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:30:06.657118 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:30:06.657118 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 18:30:06.657118 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 18:30:06.657118 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 18:30:06.657118 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 18:30:06.657118 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 18:30:06.657118 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 18:30:06.657118 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 18:30:06.657118 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 18:30:06.657118 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 18:30:06.657118 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 18:30:06.657118 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 18:30:06.657118 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 18:30:06.657118 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 18:30:06.657118 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 18:30:06.657118 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-409245276 could not be found. (HTTP 404) (Request-ID: req-b41d80c9-d403-40c9-9681-8dacd82e2faa) Jul 28 18:30:06.657118 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:30:06.657118 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:30:06.657118 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:30:06.658762 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:30:06.658762 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 28 18:30:06.658762 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 28 18:30:06.658762 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 18:30:06.658762 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 18:30:06.658762 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 18:30:06.658762 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 18:30:06.658762 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 18:30:06.658762 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 18:30:06.658762 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 18:30:06.658762 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 18:30:06.658762 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 18:30:06.658762 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 18:30:06.658762 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 18:30:06.658762 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 18:30:06.658762 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 18:30:06.658762 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 18:30:06.658762 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 18:30:06.658762 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 18:30:06.660839 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 18:30:06.660839 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 18:30:06.660839 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 18:30:06.660839 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 18:30:06.660839 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-409245276 could not be found. Jul 28 18:30:06.660839 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:30:06.660839 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:30:06.660839 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:30:06.660839 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:30:06.660839 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:30:06.660839 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:30:06.660839 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:30:06.660839 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:30:06.660839 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 18:30:06.660839 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 18:30:06.660839 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:30:06.660839 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:30:06.660839 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 28 18:30:06.660839 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:30:06.660839 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-409245276 could not be found. Jul 28 18:30:06.662490 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:30:06.662490 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:30:06.662490 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:30:06.662490 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:30:06.662490 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:30:06.662490 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:30:06.662490 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:30:06.662490 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:30:06.662490 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-409245276 could not be found. Jul 28 18:30:06.662490 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:30:06.662490 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-a8166bd2-050f-4df2-a741-740c4e5c76aa tempest-VolumesNegativeTest-1673716597 tempest-VolumesNegativeTest-1673716597-project] Returning 404 to user: Volume tempest-invalid-409245276 could not be found. {{(pid=118454) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:30:06.662490 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-a8166bd2-050f-4df2-a741-740c4e5c76aa tempest-VolumesNegativeTest-1673716597 tempest-VolumesNegativeTest-1673716597-project] 10.222.0.86 "DELETE /compute/v2.1/os-volumes/tempest-invalid-409245276" status: 404 len: 98 microversion: 2.1 time: 0.035409 Jul 28 18:30:06.662490 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 661/1317] 10.222.0.86 () {58 vars in 1215 bytes} [Thu Jul 28 18:30:06 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-409245276 => generated 98 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 18:30:06.665925 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ee4ef4a9-f9ab-4152-a9c1-0d6fcde34dd4 tempest-VolumesNegativeTest-1673716597 tempest-VolumesNegativeTest-1673716597-project] 10.222.0.86 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003711 Jul 28 18:30:06.666412 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 657/1318] 10.222.0.86 () {58 vars in 1140 bytes} [Thu Jul 28 18:30:06 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 28 18:30:06.674214 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-5aa8c7cb-5313-41ce-bbbd-fb7b29c5fa64 tempest-VolumesNegativeTest-1673716597 tempest-VolumesNegativeTest-1673716597-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003563 Jul 28 18:30:06.674638 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 662/1319] 10.222.0.86 () {58 vars in 1137 bytes} [Thu Jul 28 18:30:06 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 4 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jul 28 18:30:06.682506 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-87656423-c0cd-4a10-ac8a-0ab5655fdadd tempest-VolumesNegativeTest-1673716597 tempest-VolumesNegativeTest-1673716597-project] Calling method '.version_select at 0x7f6fe2004160>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:30:06.710189 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.wsgi [None req-87656423-c0cd-4a10-ac8a-0ab5655fdadd tempest-VolumesNegativeTest-1673716597 tempest-VolumesNegativeTest-1673716597-project] HTTP exception thrown: Volume 77d42b60-e680-4737-9c3b-dbd70d75abbb could not be found. Jul 28 18:30:06.712146 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-87656423-c0cd-4a10-ac8a-0ab5655fdadd tempest-VolumesNegativeTest-1673716597 tempest-VolumesNegativeTest-1673716597-project] Request method failure captured: Jul 28 18:30:06.712146 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: request: DELETE /compute/v2.1/os-volumes/77d42b60-e680-4737-9c3b-dbd70d75abbb HTTP/1.1 Jul 28 18:30:06.712146 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Accept: application/json Jul 28 18:30:06.712146 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Accept-Encoding: identity Jul 28 18:30:06.712146 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Connection: close Jul 28 18:30:06.712146 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Content-Length: 0 Jul 28 18:30:06.712146 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Content-Type: application/json Jul 28 18:30:06.712146 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Host: 10.222.0.86 Jul 28 18:30:06.712146 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Openstack-System-Scope: None Jul 28 18:30:06.712146 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: User-Agent: python-urllib3/1.26.10 Jul 28 18:30:06.712146 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Auth-Token: gAAAAABi4tWuMy0HbP4yWqCWiVB4kO8gllRHauYC6ANOHMSQ25bHsdb_hYgFvVMKuQPWiNvTew7WtC4-NtSmynCdVdw7RUD4Vv_AS7eTTM6V-aKyKEvH-q_SZFjoYKp_mRxWANao5BFbBcMdlMfrGBvKWgC3UvjS23yDlRvOdQnzzhLmG_MIQSE Jul 28 18:30:06.712146 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Domain-Id: None Jul 28 18:30:06.712146 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Domain-Name: None Jul 28 18:30:06.712146 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Identity-Status: Confirmed Jul 28 18:30:06.712146 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Is-Admin-Project: True Jul 28 18:30:06.712146 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Id: default Jul 28 18:30:06.712146 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Name: Default Jul 28 18:30:06.712146 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Id: a9db7b96f21f441bb275a26c2942a0e1 Jul 28 18:30:06.712146 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Name: tempest-VolumesNegativeTest-1673716597 Jul 28 18:30:06.712146 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Role: member,reader Jul 28 18:30:06.712146 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Roles: member,reader Jul 28 18:30:06.713923 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_a9db7b96f21f441bb275a26c2942a0e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/a9db7b96f21f441bb275a26c2942a0e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/a9db7b96f21f441bb275a26c2942a0e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/a9db7b96f21f441bb275a26c2942a0e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}] Jul 28 18:30:06.713923 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant: tempest-VolumesNegativeTest-1673716597 Jul 28 18:30:06.713923 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant-Id: a9db7b96f21f441bb275a26c2942a0e1 Jul 28 18:30:06.713923 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant-Name: tempest-VolumesNegativeTest-1673716597 Jul 28 18:30:06.713923 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User: tempest-VolumesNegativeTest-1673716597-project Jul 28 18:30:06.713923 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Id: default Jul 28 18:30:06.713923 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Name: Default Jul 28 18:30:06.713923 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Id: a44207d124074e34b0bb60fd4bc59259 Jul 28 18:30:06.713923 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Name: tempest-VolumesNegativeTest-1673716597-project Jul 28 18:30:06.713923 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: method: Jul 28 18:30:06.713923 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: exception: Volume 77d42b60-e680-4737-9c3b-dbd70d75abbb could not be found. Jul 28 18:30:06.713923 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: action_args: {'id': '77d42b60-e680-4737-9c3b-dbd70d75abbb'} Jul 28 18:30:06.713923 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:30:06.715002 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:30:06.715002 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 18:30:06.715002 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 18:30:06.715002 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 18:30:06.715002 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 18:30:06.715002 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 18:30:06.715002 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 18:30:06.715002 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 18:30:06.715002 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 18:30:06.715002 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 18:30:06.715002 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 18:30:06.715002 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 18:30:06.715002 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 18:30:06.715002 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 18:30:06.715002 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 18:30:06.715002 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 77d42b60-e680-4737-9c3b-dbd70d75abbb could not be found. (HTTP 404) (Request-ID: req-57139bb2-761a-4fea-8223-748c7cbedfc3) Jul 28 18:30:06.715002 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:30:06.715002 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:30:06.715002 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:30:06.716512 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:30:06.716512 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 28 18:30:06.716512 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 28 18:30:06.716512 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 18:30:06.716512 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 18:30:06.716512 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 18:30:06.716512 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 18:30:06.716512 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 18:30:06.716512 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 18:30:06.716512 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 18:30:06.716512 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 18:30:06.716512 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 18:30:06.716512 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 18:30:06.716512 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 18:30:06.716512 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 18:30:06.716512 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 18:30:06.716512 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 18:30:06.716512 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 18:30:06.716512 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 18:30:06.718092 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 18:30:06.718092 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 18:30:06.718092 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 18:30:06.718092 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 18:30:06.718092 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 77d42b60-e680-4737-9c3b-dbd70d75abbb could not be found. Jul 28 18:30:06.718092 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:30:06.718092 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:30:06.718092 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:30:06.718092 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:30:06.718092 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:30:06.718092 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:30:06.718092 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:30:06.718092 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:30:06.718092 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 18:30:06.718092 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 18:30:06.718092 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:30:06.718092 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:30:06.718092 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 28 18:30:06.718092 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:30:06.719567 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 77d42b60-e680-4737-9c3b-dbd70d75abbb could not be found. Jul 28 18:30:06.719567 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:30:06.719567 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:30:06.719567 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:30:06.719567 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:30:06.719567 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:30:06.719567 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:30:06.719567 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:30:06.719567 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:30:06.719567 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 77d42b60-e680-4737-9c3b-dbd70d75abbb could not be found. Jul 28 18:30:06.719567 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:30:06.719567 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-87656423-c0cd-4a10-ac8a-0ab5655fdadd tempest-VolumesNegativeTest-1673716597 tempest-VolumesNegativeTest-1673716597-project] Returning 404 to user: Volume 77d42b60-e680-4737-9c3b-dbd70d75abbb could not be found. {{(pid=118453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:30:06.719567 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-87656423-c0cd-4a10-ac8a-0ab5655fdadd tempest-VolumesNegativeTest-1673716597 tempest-VolumesNegativeTest-1673716597-project] 10.222.0.86 "DELETE /compute/v2.1/os-volumes/77d42b60-e680-4737-9c3b-dbd70d75abbb" status: 404 len: 109 microversion: 2.1 time: 0.034611 Jul 28 18:30:06.719567 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 658/1320] 10.222.0.86 () {58 vars in 1248 bytes} [Thu Jul 28 18:30:06 2022] DELETE /compute/v2.1/os-volumes/77d42b60-e680-4737-9c3b-dbd70d75abbb => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 18:30:06.723766 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-b8266cfb-1ca2-45c8-869b-1939369993c3 tempest-VolumesNegativeTest-1673716597 tempest-VolumesNegativeTest-1673716597-project] Calling method '.version_select at 0x7f6fe2357e50>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:30:06.750936 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.wsgi [None req-b8266cfb-1ca2-45c8-869b-1939369993c3 tempest-VolumesNegativeTest-1673716597 tempest-VolumesNegativeTest-1673716597-project] HTTP exception thrown: Volume f0e75283-0315-4516-946d-3ef60a77ee18 could not be found. Jul 28 18:30:06.753070 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-b8266cfb-1ca2-45c8-869b-1939369993c3 tempest-VolumesNegativeTest-1673716597 tempest-VolumesNegativeTest-1673716597-project] Request method failure captured: Jul 28 18:30:06.753070 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: request: GET /compute/v2.1/os-volumes/f0e75283-0315-4516-946d-3ef60a77ee18 HTTP/1.1 Jul 28 18:30:06.753070 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Accept: application/json Jul 28 18:30:06.753070 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Accept-Encoding: identity Jul 28 18:30:06.753070 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Connection: close Jul 28 18:30:06.753070 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Content-Length: 0 Jul 28 18:30:06.753070 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Content-Type: application/json Jul 28 18:30:06.753070 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Host: 10.222.0.86 Jul 28 18:30:06.753070 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Openstack-System-Scope: None Jul 28 18:30:06.753070 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: User-Agent: python-urllib3/1.26.10 Jul 28 18:30:06.753070 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Auth-Token: gAAAAABi4tWuMy0HbP4yWqCWiVB4kO8gllRHauYC6ANOHMSQ25bHsdb_hYgFvVMKuQPWiNvTew7WtC4-NtSmynCdVdw7RUD4Vv_AS7eTTM6V-aKyKEvH-q_SZFjoYKp_mRxWANao5BFbBcMdlMfrGBvKWgC3UvjS23yDlRvOdQnzzhLmG_MIQSE Jul 28 18:30:06.753070 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Domain-Id: None Jul 28 18:30:06.753070 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Domain-Name: None Jul 28 18:30:06.753070 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Identity-Status: Confirmed Jul 28 18:30:06.753070 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Is-Admin-Project: True Jul 28 18:30:06.753070 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Domain-Id: default Jul 28 18:30:06.753070 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Domain-Name: Default Jul 28 18:30:06.753070 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Id: a9db7b96f21f441bb275a26c2942a0e1 Jul 28 18:30:06.753070 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Project-Name: tempest-VolumesNegativeTest-1673716597 Jul 28 18:30:06.753070 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Role: member,reader Jul 28 18:30:06.753070 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Roles: member,reader Jul 28 18:30:06.755281 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_a9db7b96f21f441bb275a26c2942a0e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/a9db7b96f21f441bb275a26c2942a0e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/a9db7b96f21f441bb275a26c2942a0e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/a9db7b96f21f441bb275a26c2942a0e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}] Jul 28 18:30:06.755281 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant: tempest-VolumesNegativeTest-1673716597 Jul 28 18:30:06.755281 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant-Id: a9db7b96f21f441bb275a26c2942a0e1 Jul 28 18:30:06.755281 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-Tenant-Name: tempest-VolumesNegativeTest-1673716597 Jul 28 18:30:06.755281 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User: tempest-VolumesNegativeTest-1673716597-project Jul 28 18:30:06.755281 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Domain-Id: default Jul 28 18:30:06.755281 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Domain-Name: Default Jul 28 18:30:06.755281 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Id: a44207d124074e34b0bb60fd4bc59259 Jul 28 18:30:06.755281 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: X-User-Name: tempest-VolumesNegativeTest-1673716597-project Jul 28 18:30:06.755281 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: method: Jul 28 18:30:06.755281 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: exception: Volume f0e75283-0315-4516-946d-3ef60a77ee18 could not be found. Jul 28 18:30:06.755281 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: action_args: {'id': 'f0e75283-0315-4516-946d-3ef60a77ee18'} Jul 28 18:30:06.755281 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:30:06.756434 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:30:06.756434 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 18:30:06.756434 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 18:30:06.756434 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 18:30:06.756434 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 18:30:06.756434 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 18:30:06.756434 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 18:30:06.756434 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 18:30:06.756434 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 18:30:06.756434 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 18:30:06.756434 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 18:30:06.756434 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 18:30:06.756434 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 18:30:06.756434 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 18:30:06.756434 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 18:30:06.756434 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f0e75283-0315-4516-946d-3ef60a77ee18 could not be found. (HTTP 404) (Request-ID: req-ef0c33c1-5e20-425c-9a0b-bac121cb47d7) Jul 28 18:30:06.756434 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:30:06.756434 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:30:06.756434 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:30:06.758123 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:30:06.758123 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 28 18:30:06.758123 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 28 18:30:06.758123 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 18:30:06.758123 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 18:30:06.758123 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 18:30:06.758123 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 18:30:06.758123 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 18:30:06.758123 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 18:30:06.758123 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 18:30:06.758123 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 18:30:06.758123 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 18:30:06.758123 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 18:30:06.758123 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 18:30:06.758123 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 18:30:06.758123 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 18:30:06.758123 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 18:30:06.758123 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 18:30:06.758123 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 18:30:06.759590 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 18:30:06.759590 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 18:30:06.759590 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 18:30:06.759590 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 18:30:06.759590 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f0e75283-0315-4516-946d-3ef60a77ee18 could not be found. Jul 28 18:30:06.759590 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:30:06.759590 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:30:06.759590 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:30:06.759590 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:30:06.759590 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:30:06.759590 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:30:06.759590 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:30:06.759590 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:30:06.759590 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 18:30:06.759590 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 18:30:06.759590 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:30:06.759590 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:30:06.759590 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 28 18:30:06.759590 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:30:06.761111 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f0e75283-0315-4516-946d-3ef60a77ee18 could not be found. Jul 28 18:30:06.761111 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:30:06.761111 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:30:06.761111 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:30:06.761111 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:30:06.761111 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:30:06.761111 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:30:06.761111 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:30:06.761111 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:30:06.761111 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f0e75283-0315-4516-946d-3ef60a77ee18 could not be found. Jul 28 18:30:06.761111 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR nova.api.openstack.wsgi Jul 28 18:30:06.761111 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-b8266cfb-1ca2-45c8-869b-1939369993c3 tempest-VolumesNegativeTest-1673716597 tempest-VolumesNegativeTest-1673716597-project] Returning 404 to user: Volume f0e75283-0315-4516-946d-3ef60a77ee18 could not be found. {{(pid=118454) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:30:06.761111 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-b8266cfb-1ca2-45c8-869b-1939369993c3 tempest-VolumesNegativeTest-1673716597 tempest-VolumesNegativeTest-1673716597-project] 10.222.0.86 "GET /compute/v2.1/os-volumes/f0e75283-0315-4516-946d-3ef60a77ee18" status: 404 len: 109 microversion: 2.1 time: 0.035711 Jul 28 18:30:06.761111 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 663/1321] 10.222.0.86 () {58 vars in 1245 bytes} [Thu Jul 28 18:30:06 2022] GET /compute/v2.1/os-volumes/f0e75283-0315-4516-946d-3ef60a77ee18 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 18:30:15.363547 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-a0d723fa-8042-41eb-a735-128e25d53af8 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1010172748", "imageRef": "61912422-61cd-4ced-a573-85ee305e010f", "flavorRef": "452", "networks": [{"uuid": "5a2c91d4-4812-4415-8f68-db65a25a7ee7"}]}} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:30:15.418125 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.network.neutron [None req-a0d723fa-8042-41eb-a735-128e25d53af8 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] validate_networks() for [('5a2c91d4-4812-4415-8f68-db65a25a7ee7', None, None, None, None, None)] {{(pid=118453) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 18:30:15.762189 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-a0d723fa-8042-41eb-a735-128e25d53af8 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Flavor limits 0:0:0 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 18:30:15.762616 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-a0d723fa-8042-41eb-a735-128e25d53af8 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Image limits 0:0:0 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 18:30:15.763090 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-a0d723fa-8042-41eb-a735-128e25d53af8 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Flavor pref 0:0:0 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 18:30:15.763502 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-a0d723fa-8042-41eb-a735-128e25d53af8 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Image pref 0:0:0 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 18:30:15.763914 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.virt.hardware [None req-a0d723fa-8042-41eb-a735-128e25d53af8 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118453) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 18:30:15.772908 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a0d723fa-8042-41eb-a735-128e25d53af8 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:30:15.773250 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a0d723fa-8042-41eb-a735-128e25d53af8 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:30:15.774050 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a0d723fa-8042-41eb-a735-128e25d53af8 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:30:15.774485 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-a0d723fa-8042-41eb-a735-128e25d53af8 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:30:15.791866 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.quota [None req-a0d723fa-8042-41eb-a735-128e25d53af8 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Getting quotas for project f1e8613cb3f4463a8450d22995801d40. Resources: {'cores', 'ram', 'instances'} {{(pid=118453) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 18:30:15.795718 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.quota [None req-a0d723fa-8042-41eb-a735-128e25d53af8 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Getting quotas for user 4649c6a25797428faacc2fd3857568df and project f1e8613cb3f4463a8450d22995801d40. Resources: {'cores', 'ram', 'instances'} {{(pid=118453) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 18:30:15.807035 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-a0d723fa-8042-41eb-a735-128e25d53af8 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Going to run 1 instances... {{(pid=118453) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 18:30:15.809278 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-a0d723fa-8042-41eb-a735-128e25d53af8 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] [instance: 84ce28d4-c5a8-41ac-a31a-2dd0a7a06127] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='61912422-61cd-4ced-a573-85ee305e010f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118453) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 18:30:15.922855 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-a0d723fa-8042-41eb-a735-128e25d53af8 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.564596 Jul 28 18:30:15.923557 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 659/1322] 10.222.0.86 () {60 vars in 1147 bytes} [Thu Jul 28 18:30:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 18:30:15.935999 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-c202a1ea-7537-4edd-a29e-cf15f3107dd8 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:30:15.936616 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-c202a1ea-7537-4edd-a29e-cf15f3107dd8 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] [instance: 84ce28d4-c5a8-41ac-a31a-2dd0a7a06127] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:30:15.989985 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-c202a1ea-7537-4edd-a29e-cf15f3107dd8 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4649c6a25797428faacc2fd3857568df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e8613cb3f4463a8450d22995801d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:30:15.996533 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-c202a1ea-7537-4edd-a29e-cf15f3107dd8 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] 10.222.0.86 "GET /compute/v2.1/servers/84ce28d4-c5a8-41ac-a31a-2dd0a7a06127" status: 200 len: 1219 microversion: 2.1 time: 0.065588 Jul 28 18:30:15.997124 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 664/1323] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:30:15 2022] GET /compute/v2.1/servers/84ce28d4-c5a8-41ac-a31a-2dd0a7a06127 => generated 1219 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:30:17.017286 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-16301624-1c1b-4402-a4d7-ca061d7dd937 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:30:17.017965 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-16301624-1c1b-4402-a4d7-ca061d7dd937 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] [instance: 84ce28d4-c5a8-41ac-a31a-2dd0a7a06127] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:30:17.069811 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-16301624-1c1b-4402-a4d7-ca061d7dd937 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4649c6a25797428faacc2fd3857568df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e8613cb3f4463a8450d22995801d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:30:17.076675 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-16301624-1c1b-4402-a4d7-ca061d7dd937 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] 10.222.0.86 "GET /compute/v2.1/servers/84ce28d4-c5a8-41ac-a31a-2dd0a7a06127" status: 200 len: 1219 microversion: 2.1 time: 0.063753 Jul 28 18:30:17.077417 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 660/1324] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:30:17 2022] GET /compute/v2.1/servers/84ce28d4-c5a8-41ac-a31a-2dd0a7a06127 => generated 1219 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:30:18.098003 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-aa2079c3-f39b-42d6-9368-86df8fd1d1a7 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:30:18.098618 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-aa2079c3-f39b-42d6-9368-86df8fd1d1a7 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] [instance: 84ce28d4-c5a8-41ac-a31a-2dd0a7a06127] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:30:18.105193 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-aa2079c3-f39b-42d6-9368-86df8fd1d1a7 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:30:18.105651 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-aa2079c3-f39b-42d6-9368-86df8fd1d1a7 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:30:18.106416 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-aa2079c3-f39b-42d6-9368-86df8fd1d1a7 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:30:18.106859 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-aa2079c3-f39b-42d6-9368-86df8fd1d1a7 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:30:18.167290 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-aa2079c3-f39b-42d6-9368-86df8fd1d1a7 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4649c6a25797428faacc2fd3857568df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e8613cb3f4463a8450d22995801d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:30:18.174720 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-aa2079c3-f39b-42d6-9368-86df8fd1d1a7 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] 10.222.0.86 "GET /compute/v2.1/servers/84ce28d4-c5a8-41ac-a31a-2dd0a7a06127" status: 200 len: 1223 microversion: 2.1 time: 0.080622 Jul 28 18:30:18.175279 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 665/1325] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:30:18 2022] GET /compute/v2.1/servers/84ce28d4-c5a8-41ac-a31a-2dd0a7a06127 => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:30:19.195405 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-537b5ab7-aca8-4e60-9cd2-00ceb340951c tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:30:19.196015 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-537b5ab7-aca8-4e60-9cd2-00ceb340951c tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] [instance: 84ce28d4-c5a8-41ac-a31a-2dd0a7a06127] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:30:19.203444 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-537b5ab7-aca8-4e60-9cd2-00ceb340951c tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:30:19.208830 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-537b5ab7-aca8-4e60-9cd2-00ceb340951c tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:30:19.208830 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-537b5ab7-aca8-4e60-9cd2-00ceb340951c tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:30:19.208830 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-537b5ab7-aca8-4e60-9cd2-00ceb340951c tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:30:19.270057 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-537b5ab7-aca8-4e60-9cd2-00ceb340951c tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4649c6a25797428faacc2fd3857568df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e8613cb3f4463a8450d22995801d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:30:19.277568 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-537b5ab7-aca8-4e60-9cd2-00ceb340951c tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] 10.222.0.86 "GET /compute/v2.1/servers/84ce28d4-c5a8-41ac-a31a-2dd0a7a06127" status: 200 len: 1223 microversion: 2.1 time: 0.086044 Jul 28 18:30:19.278154 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 661/1326] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:30:19 2022] GET /compute/v2.1/servers/84ce28d4-c5a8-41ac-a31a-2dd0a7a06127 => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:30:20.298664 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-0756c8a0-9790-47e5-bf49-ee019bca7eb3 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:30:20.299365 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-0756c8a0-9790-47e5-bf49-ee019bca7eb3 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] [instance: 84ce28d4-c5a8-41ac-a31a-2dd0a7a06127] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:30:20.306644 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-0756c8a0-9790-47e5-bf49-ee019bca7eb3 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:30:20.307104 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-0756c8a0-9790-47e5-bf49-ee019bca7eb3 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:30:20.307882 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-0756c8a0-9790-47e5-bf49-ee019bca7eb3 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:30:20.308319 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-0756c8a0-9790-47e5-bf49-ee019bca7eb3 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:30:20.373637 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-0756c8a0-9790-47e5-bf49-ee019bca7eb3 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4649c6a25797428faacc2fd3857568df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e8613cb3f4463a8450d22995801d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:30:20.381149 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-0756c8a0-9790-47e5-bf49-ee019bca7eb3 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] 10.222.0.86 "GET /compute/v2.1/servers/84ce28d4-c5a8-41ac-a31a-2dd0a7a06127" status: 200 len: 1289 microversion: 2.1 time: 0.086352 Jul 28 18:30:20.381708 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 666/1327] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:30:20 2022] GET /compute/v2.1/servers/84ce28d4-c5a8-41ac-a31a-2dd0a7a06127 => generated 1289 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:30:21.401590 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-7a55ae63-82ca-41f4-ae8b-b7e578c4b64c tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:30:21.402139 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-7a55ae63-82ca-41f4-ae8b-b7e578c4b64c tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] [instance: 84ce28d4-c5a8-41ac-a31a-2dd0a7a06127] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:30:21.408636 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7a55ae63-82ca-41f4-ae8b-b7e578c4b64c tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:30:21.409120 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7a55ae63-82ca-41f4-ae8b-b7e578c4b64c tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:30:21.409886 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7a55ae63-82ca-41f4-ae8b-b7e578c4b64c tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:30:21.410328 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-7a55ae63-82ca-41f4-ae8b-b7e578c4b64c tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:30:21.546037 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-7a55ae63-82ca-41f4-ae8b-b7e578c4b64c tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4649c6a25797428faacc2fd3857568df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e8613cb3f4463a8450d22995801d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:30:21.554178 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-7a55ae63-82ca-41f4-ae8b-b7e578c4b64c tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] 10.222.0.86 "GET /compute/v2.1/servers/84ce28d4-c5a8-41ac-a31a-2dd0a7a06127" status: 200 len: 1319 microversion: 2.1 time: 0.156634 Jul 28 18:30:21.554750 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 662/1328] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:30:21 2022] GET /compute/v2.1/servers/84ce28d4-c5a8-41ac-a31a-2dd0a7a06127 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:30:21.718878 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [req-d2b22211-908c-403e-bec3-305cc2b3aa7e req-b7d373c3-2032-4a31-bba3-92c0df08ee75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84ce28d4-c5a8-41ac-a31a-2dd0a7a06127", "tag": "5ef3f7e1-2aa5-4047-9de9-ce7526e7d163"}]} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:30:21.729402 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-d2b22211-908c-403e-bec3-305cc2b3aa7e req-b7d373c3-2032-4a31-bba3-92c0df08ee75 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:30:21.733732 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-d2b22211-908c-403e-bec3-305cc2b3aa7e req-b7d373c3-2032-4a31-bba3-92c0df08ee75 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:30:21.741037 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.compute.server_external_events [req-d2b22211-908c-403e-bec3-305cc2b3aa7e req-b7d373c3-2032-4a31-bba3-92c0df08ee75 service nova] Creating event network-changed:5ef3f7e1-2aa5-4047-9de9-ce7526e7d163 for instance 84ce28d4-c5a8-41ac-a31a-2dd0a7a06127 on hv-cinder-84617 Jul 28 18:30:21.745925 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [req-d2b22211-908c-403e-bec3-305cc2b3aa7e req-b7d373c3-2032-4a31-bba3-92c0df08ee75 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030923 Jul 28 18:30:21.750523 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 667/1329] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:30:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 18:30:22.575434 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-e504d3b0-49d6-4a5f-b6b0-8dde64145904 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:30:22.576040 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-e504d3b0-49d6-4a5f-b6b0-8dde64145904 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] [instance: 84ce28d4-c5a8-41ac-a31a-2dd0a7a06127] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:30:22.583141 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e504d3b0-49d6-4a5f-b6b0-8dde64145904 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:30:22.583586 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e504d3b0-49d6-4a5f-b6b0-8dde64145904 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:30:22.584349 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e504d3b0-49d6-4a5f-b6b0-8dde64145904 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:30:22.584806 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-e504d3b0-49d6-4a5f-b6b0-8dde64145904 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:30:22.717934 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-e504d3b0-49d6-4a5f-b6b0-8dde64145904 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4649c6a25797428faacc2fd3857568df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e8613cb3f4463a8450d22995801d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:30:22.725864 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-e504d3b0-49d6-4a5f-b6b0-8dde64145904 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] 10.222.0.86 "GET /compute/v2.1/servers/84ce28d4-c5a8-41ac-a31a-2dd0a7a06127" status: 200 len: 1319 microversion: 2.1 time: 0.154337 Jul 28 18:30:22.726459 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 663/1330] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:30:22 2022] GET /compute/v2.1/servers/84ce28d4-c5a8-41ac-a31a-2dd0a7a06127 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:30:23.747026 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-dcb8e997-230e-46bc-b114-0a09cc8fe6b4 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:30:23.747680 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-dcb8e997-230e-46bc-b114-0a09cc8fe6b4 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] [instance: 84ce28d4-c5a8-41ac-a31a-2dd0a7a06127] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:30:23.753948 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-dcb8e997-230e-46bc-b114-0a09cc8fe6b4 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:30:23.754396 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-dcb8e997-230e-46bc-b114-0a09cc8fe6b4 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:30:23.755154 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-dcb8e997-230e-46bc-b114-0a09cc8fe6b4 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:30:23.755592 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-dcb8e997-230e-46bc-b114-0a09cc8fe6b4 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:30:23.890237 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-dcb8e997-230e-46bc-b114-0a09cc8fe6b4 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4649c6a25797428faacc2fd3857568df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e8613cb3f4463a8450d22995801d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:30:23.898169 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-dcb8e997-230e-46bc-b114-0a09cc8fe6b4 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] 10.222.0.86 "GET /compute/v2.1/servers/84ce28d4-c5a8-41ac-a31a-2dd0a7a06127" status: 200 len: 1319 microversion: 2.1 time: 0.155921 Jul 28 18:30:23.898730 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 668/1331] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:30:23 2022] GET /compute/v2.1/servers/84ce28d4-c5a8-41ac-a31a-2dd0a7a06127 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:30:24.919690 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-43440897-a283-4ba5-89a3-659a4c19eeb5 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:30:24.920298 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-43440897-a283-4ba5-89a3-659a4c19eeb5 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] [instance: 84ce28d4-c5a8-41ac-a31a-2dd0a7a06127] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:30:24.927486 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-43440897-a283-4ba5-89a3-659a4c19eeb5 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:30:24.927934 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-43440897-a283-4ba5-89a3-659a4c19eeb5 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:30:24.928697 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-43440897-a283-4ba5-89a3-659a4c19eeb5 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:30:24.929190 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-43440897-a283-4ba5-89a3-659a4c19eeb5 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:30:25.058576 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-43440897-a283-4ba5-89a3-659a4c19eeb5 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4649c6a25797428faacc2fd3857568df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e8613cb3f4463a8450d22995801d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:30:25.066037 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-43440897-a283-4ba5-89a3-659a4c19eeb5 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] 10.222.0.86 "GET /compute/v2.1/servers/84ce28d4-c5a8-41ac-a31a-2dd0a7a06127" status: 200 len: 1319 microversion: 2.1 time: 0.150248 Jul 28 18:30:25.066624 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 664/1332] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:30:24 2022] GET /compute/v2.1/servers/84ce28d4-c5a8-41ac-a31a-2dd0a7a06127 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:30:26.086769 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-65abeeee-312c-4692-a02a-b13bdf65b92d tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:30:26.087420 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-65abeeee-312c-4692-a02a-b13bdf65b92d tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] [instance: 84ce28d4-c5a8-41ac-a31a-2dd0a7a06127] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:30:26.090966 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell0:SELECT=2 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:30:26.095215 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-65abeeee-312c-4692-a02a-b13bdf65b92d tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:30:26.095668 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-65abeeee-312c-4692-a02a-b13bdf65b92d tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:30:26.096460 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-65abeeee-312c-4692-a02a-b13bdf65b92d tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:30:26.096904 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-65abeeee-312c-4692-a02a-b13bdf65b92d tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:30:26.241295 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-65abeeee-312c-4692-a02a-b13bdf65b92d tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4649c6a25797428faacc2fd3857568df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e8613cb3f4463a8450d22995801d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:30:26.248736 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-65abeeee-312c-4692-a02a-b13bdf65b92d tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] 10.222.0.86 "GET /compute/v2.1/servers/84ce28d4-c5a8-41ac-a31a-2dd0a7a06127" status: 200 len: 1319 microversion: 2.1 time: 0.165833 Jul 28 18:30:26.249459 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 669/1333] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:30:26 2022] GET /compute/v2.1/servers/84ce28d4-c5a8-41ac-a31a-2dd0a7a06127 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:30:27.269555 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-005903b8-dc48-4348-b9ec-3146f4dd6312 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:30:27.270819 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-005903b8-dc48-4348-b9ec-3146f4dd6312 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] [instance: 84ce28d4-c5a8-41ac-a31a-2dd0a7a06127] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:30:27.272939 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell0:SELECT=2 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:30:27.274130 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell0:SELECT=8 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:30:27.278949 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-005903b8-dc48-4348-b9ec-3146f4dd6312 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:30:27.279401 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-005903b8-dc48-4348-b9ec-3146f4dd6312 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:30:27.280157 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-005903b8-dc48-4348-b9ec-3146f4dd6312 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:30:27.280594 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-005903b8-dc48-4348-b9ec-3146f4dd6312 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:30:27.413164 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-005903b8-dc48-4348-b9ec-3146f4dd6312 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4649c6a25797428faacc2fd3857568df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e8613cb3f4463a8450d22995801d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:30:27.423015 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-005903b8-dc48-4348-b9ec-3146f4dd6312 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] 10.222.0.86 "GET /compute/v2.1/servers/84ce28d4-c5a8-41ac-a31a-2dd0a7a06127" status: 200 len: 1319 microversion: 2.1 time: 0.157305 Jul 28 18:30:27.423841 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 665/1334] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:30:27 2022] GET /compute/v2.1/servers/84ce28d4-c5a8-41ac-a31a-2dd0a7a06127 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:30:28.443702 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-bc470925-0395-4d69-ae0c-97021064e30f tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:30:28.444324 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-bc470925-0395-4d69-ae0c-97021064e30f tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] [instance: 84ce28d4-c5a8-41ac-a31a-2dd0a7a06127] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:30:28.450869 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-bc470925-0395-4d69-ae0c-97021064e30f tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:30:28.451324 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-bc470925-0395-4d69-ae0c-97021064e30f tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:30:28.452094 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-bc470925-0395-4d69-ae0c-97021064e30f tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:30:28.453056 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-bc470925-0395-4d69-ae0c-97021064e30f tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:30:28.584560 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-bc470925-0395-4d69-ae0c-97021064e30f tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4649c6a25797428faacc2fd3857568df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e8613cb3f4463a8450d22995801d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:30:28.591964 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-bc470925-0395-4d69-ae0c-97021064e30f tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] 10.222.0.86 "GET /compute/v2.1/servers/84ce28d4-c5a8-41ac-a31a-2dd0a7a06127" status: 200 len: 1319 microversion: 2.1 time: 0.152152 Jul 28 18:30:28.592534 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 670/1335] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:30:28 2022] GET /compute/v2.1/servers/84ce28d4-c5a8-41ac-a31a-2dd0a7a06127 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:30:29.442291 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-65d09ae8-ea99-46d6-ab85-c386071677fa req-910d32d1-1776-4cef-908d-8e1c91443317 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84ce28d4-c5a8-41ac-a31a-2dd0a7a06127", "name": "network-vif-plugged", "status": "completed", "tag": "5ef3f7e1-2aa5-4047-9de9-ce7526e7d163"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:30:29.454613 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-65d09ae8-ea99-46d6-ab85-c386071677fa req-910d32d1-1776-4cef-908d-8e1c91443317 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:30:29.454613 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-65d09ae8-ea99-46d6-ab85-c386071677fa req-910d32d1-1776-4cef-908d-8e1c91443317 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:30:29.463444 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-65d09ae8-ea99-46d6-ab85-c386071677fa req-910d32d1-1776-4cef-908d-8e1c91443317 service nova] Creating event network-vif-plugged:5ef3f7e1-2aa5-4047-9de9-ce7526e7d163 for instance 84ce28d4-c5a8-41ac-a31a-2dd0a7a06127 on hv-cinder-84617 Jul 28 18:30:29.468790 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-65d09ae8-ea99-46d6-ab85-c386071677fa req-910d32d1-1776-4cef-908d-8e1c91443317 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158579 Jul 28 18:30:29.469409 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 666/1336] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:30:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:30:29.612623 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-d08b2265-2d30-447f-bc20-aab7f1d69d30 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:30:29.613301 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-d08b2265-2d30-447f-bc20-aab7f1d69d30 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] [instance: 84ce28d4-c5a8-41ac-a31a-2dd0a7a06127] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:30:29.620348 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d08b2265-2d30-447f-bc20-aab7f1d69d30 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:30:29.620803 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d08b2265-2d30-447f-bc20-aab7f1d69d30 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:30:29.621612 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d08b2265-2d30-447f-bc20-aab7f1d69d30 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:30:29.622050 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d08b2265-2d30-447f-bc20-aab7f1d69d30 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:30:29.755207 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-d08b2265-2d30-447f-bc20-aab7f1d69d30 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4649c6a25797428faacc2fd3857568df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e8613cb3f4463a8450d22995801d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:30:29.763406 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-d08b2265-2d30-447f-bc20-aab7f1d69d30 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] 10.222.0.86 "GET /compute/v2.1/servers/84ce28d4-c5a8-41ac-a31a-2dd0a7a06127" status: 200 len: 1319 microversion: 2.1 time: 0.154867 Jul 28 18:30:29.763966 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 671/1337] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:30:29 2022] GET /compute/v2.1/servers/84ce28d4-c5a8-41ac-a31a-2dd0a7a06127 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:30:30.784212 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-9fadaae7-7f24-4229-a72f-417cdedd7c05 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:30:30.792760 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-9fadaae7-7f24-4229-a72f-417cdedd7c05 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] [instance: 84ce28d4-c5a8-41ac-a31a-2dd0a7a06127] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:30:30.792760 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9fadaae7-7f24-4229-a72f-417cdedd7c05 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:30:30.792760 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9fadaae7-7f24-4229-a72f-417cdedd7c05 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:30:30.793140 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9fadaae7-7f24-4229-a72f-417cdedd7c05 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:30:30.793451 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9fadaae7-7f24-4229-a72f-417cdedd7c05 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:30:30.930880 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-9fadaae7-7f24-4229-a72f-417cdedd7c05 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4649c6a25797428faacc2fd3857568df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e8613cb3f4463a8450d22995801d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:30:30.938306 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-9fadaae7-7f24-4229-a72f-417cdedd7c05 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] 10.222.0.86 "GET /compute/v2.1/servers/84ce28d4-c5a8-41ac-a31a-2dd0a7a06127" status: 200 len: 1319 microversion: 2.1 time: 0.158394 Jul 28 18:30:30.938872 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 667/1338] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:30:30 2022] GET /compute/v2.1/servers/84ce28d4-c5a8-41ac-a31a-2dd0a7a06127 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:30:31.959398 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-b7758e20-353e-4b12-9b89-de6cfb28d116 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:30:31.960014 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-b7758e20-353e-4b12-9b89-de6cfb28d116 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] [instance: 84ce28d4-c5a8-41ac-a31a-2dd0a7a06127] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:30:31.966761 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b7758e20-353e-4b12-9b89-de6cfb28d116 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:30:31.967209 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b7758e20-353e-4b12-9b89-de6cfb28d116 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:30:31.967967 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b7758e20-353e-4b12-9b89-de6cfb28d116 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:30:31.968401 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b7758e20-353e-4b12-9b89-de6cfb28d116 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:30:32.096366 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-b7758e20-353e-4b12-9b89-de6cfb28d116 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4649c6a25797428faacc2fd3857568df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e8613cb3f4463a8450d22995801d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:30:32.104498 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-b7758e20-353e-4b12-9b89-de6cfb28d116 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] 10.222.0.86 "GET /compute/v2.1/servers/84ce28d4-c5a8-41ac-a31a-2dd0a7a06127" status: 200 len: 1507 microversion: 2.1 time: 0.149536 Jul 28 18:30:32.105086 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 672/1339] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:30:31 2022] GET /compute/v2.1/servers/84ce28d4-c5a8-41ac-a31a-2dd0a7a06127 => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:30:54.922472 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-821e845a-6338-4ad1-a4a5-91f0f0be4577 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0d746213-0bc4-4631-9b60-f96a979b3d72", "device": "/dev/sdb"}} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:30:54.925340 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-821e845a-6338-4ad1-a4a5-91f0f0be4577 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] [instance: 84ce28d4-c5a8-41ac-a31a-2dd0a7a06127] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:30:54.927520 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:30:54.928314 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=40 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:30:54.932944 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-821e845a-6338-4ad1-a4a5-91f0f0be4577 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:30:54.933942 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-821e845a-6338-4ad1-a4a5-91f0f0be4577 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:30:54.934695 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-821e845a-6338-4ad1-a4a5-91f0f0be4577 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:30:54.935137 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-821e845a-6338-4ad1-a4a5-91f0f0be4577 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:30:55.586342 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-821e845a-6338-4ad1-a4a5-91f0f0be4577 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] 10.222.0.86 "POST /compute/v2.1/servers/84ce28d4-c5a8-41ac-a31a-2dd0a7a06127/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.667851 Jul 28 18:30:55.587075 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 668/1340] 10.222.0.86 () {60 vars in 1323 bytes} [Thu Jul 28 18:30:54 2022] POST /compute/v2.1/servers/84ce28d4-c5a8-41ac-a31a-2dd0a7a06127/os-volume_attachments => generated 194 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:31:24.253045 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-b7696d19-98d2-4fca-80c3-82af9f8749a9 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:31:24.253603 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-b7696d19-98d2-4fca-80c3-82af9f8749a9 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] [instance: 84ce28d4-c5a8-41ac-a31a-2dd0a7a06127] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:31:24.255602 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_api:SELECT=20 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:31:24.256389 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell1:SELECT=44 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:31:24.261181 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b7696d19-98d2-4fca-80c3-82af9f8749a9 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:31:24.261684 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b7696d19-98d2-4fca-80c3-82af9f8749a9 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:31:24.262447 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b7696d19-98d2-4fca-80c3-82af9f8749a9 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:31:24.263064 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b7696d19-98d2-4fca-80c3-82af9f8749a9 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:31:24.346017 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.objects.instance [None req-b7696d19-98d2-4fca-80c3-82af9f8749a9 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lazy-loading 'services' on Instance uuid 84ce28d4-c5a8-41ac-a31a-2dd0a7a06127 {{(pid=118454) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:31:24.552938 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-b7696d19-98d2-4fca-80c3-82af9f8749a9 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] 10.222.0.86 "DELETE /compute/v2.1/servers/84ce28d4-c5a8-41ac-a31a-2dd0a7a06127/os-volume_attachments/0d746213-0bc4-4631-9b60-f96a979b3d72" status: 202 len: 0 microversion: 2.1 time: 0.303794 Jul 28 18:31:24.553707 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 673/1341] 10.222.0.86 () {58 vars in 1416 bytes} [Thu Jul 28 18:31:24 2022] DELETE /compute/v2.1/servers/84ce28d4-c5a8-41ac-a31a-2dd0a7a06127/os-volume_attachments/0d746213-0bc4-4631-9b60-f96a979b3d72 => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 18:31:25.672206 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=2 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:31:25.673064 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:31:25.677099 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-35688434-9aee-4b6e-a432-755f81971a7c tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:31:25.677685 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-35688434-9aee-4b6e-a432-755f81971a7c tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] [instance: 84ce28d4-c5a8-41ac-a31a-2dd0a7a06127] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:31:25.683781 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-35688434-9aee-4b6e-a432-755f81971a7c tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:31:25.684235 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-35688434-9aee-4b6e-a432-755f81971a7c tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:31:25.685065 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-35688434-9aee-4b6e-a432-755f81971a7c tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:31:25.685453 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-35688434-9aee-4b6e-a432-755f81971a7c tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:31:25.712488 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-35688434-9aee-4b6e-a432-755f81971a7c tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] [instance: 84ce28d4-c5a8-41ac-a31a-2dd0a7a06127] Going to try to terminate instance {{(pid=118453) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 18:31:26.103091 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-35688434-9aee-4b6e-a432-755f81971a7c tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] 10.222.0.86 "DELETE /compute/v2.1/servers/84ce28d4-c5a8-41ac-a31a-2dd0a7a06127" status: 204 len: 0 microversion: 2.1 time: 0.432081 Jul 28 18:31:26.103675 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 669/1342] 10.222.0.86 () {58 vars in 1239 bytes} [Thu Jul 28 18:31:25 2022] DELETE /compute/v2.1/servers/84ce28d4-c5a8-41ac-a31a-2dd0a7a06127 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 18:31:26.112353 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-ce50c64c-2d19-4596-b413-100efca67de5 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:31:26.113098 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-ce50c64c-2d19-4596-b413-100efca67de5 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] [instance: 84ce28d4-c5a8-41ac-a31a-2dd0a7a06127] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:31:26.120008 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ce50c64c-2d19-4596-b413-100efca67de5 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:31:26.120460 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ce50c64c-2d19-4596-b413-100efca67de5 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:31:26.121269 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ce50c64c-2d19-4596-b413-100efca67de5 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:31:26.121710 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ce50c64c-2d19-4596-b413-100efca67de5 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:31:26.252700 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-ce50c64c-2d19-4596-b413-100efca67de5 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4649c6a25797428faacc2fd3857568df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e8613cb3f4463a8450d22995801d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:31:26.260366 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-ce50c64c-2d19-4596-b413-100efca67de5 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] 10.222.0.86 "GET /compute/v2.1/servers/84ce28d4-c5a8-41ac-a31a-2dd0a7a06127" status: 200 len: 1513 microversion: 2.1 time: 0.152233 Jul 28 18:31:26.260930 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 674/1343] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:31:26 2022] GET /compute/v2.1/servers/84ce28d4-c5a8-41ac-a31a-2dd0a7a06127 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:31:27.282149 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5b08be2e-1dc8-46d7-b0eb-f7541f23e20e tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:31:27.282889 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-5b08be2e-1dc8-46d7-b0eb-f7541f23e20e tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] [instance: 84ce28d4-c5a8-41ac-a31a-2dd0a7a06127] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:31:27.289320 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5b08be2e-1dc8-46d7-b0eb-f7541f23e20e tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:31:27.289777 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5b08be2e-1dc8-46d7-b0eb-f7541f23e20e tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:31:27.290545 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5b08be2e-1dc8-46d7-b0eb-f7541f23e20e tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:31:27.290990 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5b08be2e-1dc8-46d7-b0eb-f7541f23e20e tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:31:27.423793 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-5b08be2e-1dc8-46d7-b0eb-f7541f23e20e tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4649c6a25797428faacc2fd3857568df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e8613cb3f4463a8450d22995801d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:31:27.430904 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-5b08be2e-1dc8-46d7-b0eb-f7541f23e20e tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] 10.222.0.86 "GET /compute/v2.1/servers/84ce28d4-c5a8-41ac-a31a-2dd0a7a06127" status: 200 len: 1513 microversion: 2.1 time: 0.153542 Jul 28 18:31:27.431473 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 670/1344] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:31:27 2022] GET /compute/v2.1/servers/84ce28d4-c5a8-41ac-a31a-2dd0a7a06127 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:31:28.455080 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-9caa53ef-8603-4320-bb48-79841668bca5 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:31:28.455724 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-9caa53ef-8603-4320-bb48-79841668bca5 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] [instance: 84ce28d4-c5a8-41ac-a31a-2dd0a7a06127] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:31:28.462883 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-9caa53ef-8603-4320-bb48-79841668bca5 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:31:28.463373 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-9caa53ef-8603-4320-bb48-79841668bca5 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:31:28.464153 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-9caa53ef-8603-4320-bb48-79841668bca5 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:31:28.464732 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-9caa53ef-8603-4320-bb48-79841668bca5 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:31:28.604787 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-9caa53ef-8603-4320-bb48-79841668bca5 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4649c6a25797428faacc2fd3857568df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e8613cb3f4463a8450d22995801d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:31:28.612886 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-9caa53ef-8603-4320-bb48-79841668bca5 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] 10.222.0.86 "GET /compute/v2.1/servers/84ce28d4-c5a8-41ac-a31a-2dd0a7a06127" status: 200 len: 1513 microversion: 2.1 time: 0.162602 Jul 28 18:31:28.613503 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 675/1345] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:31:28 2022] GET /compute/v2.1/servers/84ce28d4-c5a8-41ac-a31a-2dd0a7a06127 => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:31:28.872945 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [req-0bf7e5f8-af50-4273-97bb-2b42f1129cdd req-2cd2addc-8ffe-4c33-b64f-fe37c012b273 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84ce28d4-c5a8-41ac-a31a-2dd0a7a06127", "name": "network-vif-deleted", "tag": "5ef3f7e1-2aa5-4047-9de9-ce7526e7d163"}]} {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:31:28.883822 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-0bf7e5f8-af50-4273-97bb-2b42f1129cdd req-2cd2addc-8ffe-4c33-b64f-fe37c012b273 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:31:28.884269 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [req-0bf7e5f8-af50-4273-97bb-2b42f1129cdd req-2cd2addc-8ffe-4c33-b64f-fe37c012b273 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:31:28.896646 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.compute.server_external_events [req-0bf7e5f8-af50-4273-97bb-2b42f1129cdd req-2cd2addc-8ffe-4c33-b64f-fe37c012b273 service nova] Creating event network-vif-deleted:5ef3f7e1-2aa5-4047-9de9-ce7526e7d163 for instance 84ce28d4-c5a8-41ac-a31a-2dd0a7a06127 on hv-cinder-84617 Jul 28 18:31:28.903176 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [req-0bf7e5f8-af50-4273-97bb-2b42f1129cdd req-2cd2addc-8ffe-4c33-b64f-fe37c012b273 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033678 Jul 28 18:31:28.904323 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 671/1346] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:31:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:31:29.633435 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-d73aff05-098b-4b01-bac2-9815b12ba385 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:31:29.634045 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-d73aff05-098b-4b01-bac2-9815b12ba385 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] [instance: 84ce28d4-c5a8-41ac-a31a-2dd0a7a06127] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:31:29.641002 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d73aff05-098b-4b01-bac2-9815b12ba385 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:31:29.641512 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d73aff05-098b-4b01-bac2-9815b12ba385 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:31:29.642283 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d73aff05-098b-4b01-bac2-9815b12ba385 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:31:29.642754 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d73aff05-098b-4b01-bac2-9815b12ba385 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:31:29.673513 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d73aff05-098b-4b01-bac2-9815b12ba385 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:31:29.673895 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d73aff05-098b-4b01-bac2-9815b12ba385 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:31:29.674352 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.objects.instance [None req-d73aff05-098b-4b01-bac2-9815b12ba385 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lazy-loading 'fault' on Instance uuid 84ce28d4-c5a8-41ac-a31a-2dd0a7a06127 {{(pid=118454) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:31:29.719365 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-d73aff05-098b-4b01-bac2-9815b12ba385 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4649c6a25797428faacc2fd3857568df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e8613cb3f4463a8450d22995801d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:31:29.727166 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-d73aff05-098b-4b01-bac2-9815b12ba385 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] 10.222.0.86 "GET /compute/v2.1/servers/84ce28d4-c5a8-41ac-a31a-2dd0a7a06127" status: 200 len: 1309 microversion: 2.1 time: 0.097592 Jul 28 18:31:29.727751 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 676/1347] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:31:29 2022] GET /compute/v2.1/servers/84ce28d4-c5a8-41ac-a31a-2dd0a7a06127 => generated 1309 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:31:30.749712 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-9297316f-78bb-47e3-97cc-aabec6d53a95 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:31:30.750367 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-9297316f-78bb-47e3-97cc-aabec6d53a95 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] [instance: 84ce28d4-c5a8-41ac-a31a-2dd0a7a06127] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:31:30.756994 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9297316f-78bb-47e3-97cc-aabec6d53a95 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:31:30.757456 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9297316f-78bb-47e3-97cc-aabec6d53a95 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:31:30.758208 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9297316f-78bb-47e3-97cc-aabec6d53a95 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:31:30.758646 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-9297316f-78bb-47e3-97cc-aabec6d53a95 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:31:30.772195 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.wsgi [None req-9297316f-78bb-47e3-97cc-aabec6d53a95 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] HTTP exception thrown: Instance 84ce28d4-c5a8-41ac-a31a-2dd0a7a06127 could not be found. Jul 28 18:31:30.773821 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-9297316f-78bb-47e3-97cc-aabec6d53a95 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Request method failure captured: Jul 28 18:31:30.773821 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: request: GET /compute/v2.1/servers/84ce28d4-c5a8-41ac-a31a-2dd0a7a06127 HTTP/1.1 Jul 28 18:31:30.773821 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Accept: application/json Jul 28 18:31:30.773821 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Accept-Encoding: identity Jul 28 18:31:30.773821 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Connection: close Jul 28 18:31:30.773821 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Content-Length: 0 Jul 28 18:31:30.773821 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Content-Type: application/json Jul 28 18:31:30.773821 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Host: 10.222.0.86 Jul 28 18:31:30.773821 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Openstack-System-Scope: None Jul 28 18:31:30.773821 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: User-Agent: python-urllib3/1.26.10 Jul 28 18:31:30.773821 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Auth-Token: gAAAAABi4tW1twlqeNpGqjK-I4JG7wPLi59d96gjTF5Gej8rY9nJh2C8h43uZBcw9chVgUJS2yq0EwRSQQWfMC8Tuv02DWaWXsa1BCyj6z8vodLIbElo2FfDZhsmnGAIupYHQL26w7iHDu9RDu8sU_-Z5COH9ldg3FRx8TT9aC8FXGTaN0hNjAA Jul 28 18:31:30.773821 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Domain-Id: None Jul 28 18:31:30.773821 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Domain-Name: None Jul 28 18:31:30.773821 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Identity-Status: Confirmed Jul 28 18:31:30.773821 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Is-Admin-Project: True Jul 28 18:31:30.773821 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Id: default Jul 28 18:31:30.773821 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Name: Default Jul 28 18:31:30.773821 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Id: f1e8613cb3f4463a8450d22995801d40 Jul 28 18:31:30.773821 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1682304737 Jul 28 18:31:30.773821 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Role: member,reader Jul 28 18:31:30.773821 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Roles: member,reader Jul 28 18:31:30.775808 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_f1e8613cb3f4463a8450d22995801d40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/f1e8613cb3f4463a8450d22995801d40"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/f1e8613cb3f4463a8450d22995801d40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/f1e8613cb3f4463a8450d22995801d40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}] Jul 28 18:31:30.775808 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant: tempest-VolumesSnapshotTestJSON-1682304737 Jul 28 18:31:30.775808 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant-Id: f1e8613cb3f4463a8450d22995801d40 Jul 28 18:31:30.775808 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1682304737 Jul 28 18:31:30.775808 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User: tempest-VolumesSnapshotTestJSON-1682304737-project Jul 28 18:31:30.775808 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Id: default Jul 28 18:31:30.775808 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Name: Default Jul 28 18:31:30.775808 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Id: 4649c6a25797428faacc2fd3857568df Jul 28 18:31:30.775808 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Name: tempest-VolumesSnapshotTestJSON-1682304737-project Jul 28 18:31:30.775808 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: method: > Jul 28 18:31:30.775808 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: exception: Instance 84ce28d4-c5a8-41ac-a31a-2dd0a7a06127 could not be found. Jul 28 18:31:30.775808 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: action_args: {'id': '84ce28d4-c5a8-41ac-a31a-2dd0a7a06127'} Jul 28 18:31:30.776929 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:31:30.776929 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:31:30.776929 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:31:30.776929 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:31:30.776929 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:31:30.776929 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:31:30.776929 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:31:30.776929 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:31:30.776929 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:31:30.776929 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:31:30.776929 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84ce28d4-c5a8-41ac-a31a-2dd0a7a06127 could not be found. Jul 28 18:31:30.776929 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:31:30.776929 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:31:30.776929 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:31:30.776929 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:31:30.776929 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:31:30.776929 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:31:30.776929 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:31:30.776929 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:31:30.776929 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:31:30.778868 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:31:30.778868 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 18:31:30.778868 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 18:31:30.778868 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:31:30.778868 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:31:30.778868 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:31:30.778868 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:31:30.778868 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84ce28d4-c5a8-41ac-a31a-2dd0a7a06127 could not be found. Jul 28 18:31:30.778868 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:31:30.778868 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:31:30.778868 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:31:30.778868 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:31:30.778868 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:31:30.778868 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:31:30.778868 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:31:30.778868 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:31:30.778868 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84ce28d4-c5a8-41ac-a31a-2dd0a7a06127 could not be found. Jul 28 18:31:30.778868 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:31:30.780528 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-9297316f-78bb-47e3-97cc-aabec6d53a95 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Returning 404 to user: Instance 84ce28d4-c5a8-41ac-a31a-2dd0a7a06127 could not be found. {{(pid=118453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:31:30.780528 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-9297316f-78bb-47e3-97cc-aabec6d53a95 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] 10.222.0.86 "GET /compute/v2.1/servers/84ce28d4-c5a8-41ac-a31a-2dd0a7a06127" status: 404 len: 111 microversion: 2.1 time: 0.031130 Jul 28 18:31:30.780528 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 672/1348] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:31:30 2022] GET /compute/v2.1/servers/84ce28d4-c5a8-41ac-a31a-2dd0a7a06127 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:31:41.066381 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-360a44c9-c7d6-45cf-8b44-119bac8f379e tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1709160369", "imageRef": "61912422-61cd-4ced-a573-85ee305e010f", "flavorRef": "452", "networks": [{"uuid": "5a2c91d4-4812-4415-8f68-db65a25a7ee7"}]}} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:31:41.074935 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_api:SELECT=10 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:31:41.075841 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:31:41.120663 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.network.neutron [None req-360a44c9-c7d6-45cf-8b44-119bac8f379e tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] validate_networks() for [('5a2c91d4-4812-4415-8f68-db65a25a7ee7', None, None, None, None, None)] {{(pid=118454) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 18:31:41.540188 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.virt.hardware [None req-360a44c9-c7d6-45cf-8b44-119bac8f379e tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Flavor limits 0:0:0 {{(pid=118454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 18:31:41.540640 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.virt.hardware [None req-360a44c9-c7d6-45cf-8b44-119bac8f379e tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Image limits 0:0:0 {{(pid=118454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 18:31:41.541149 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.virt.hardware [None req-360a44c9-c7d6-45cf-8b44-119bac8f379e tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Flavor pref 0:0:0 {{(pid=118454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 18:31:41.541638 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.virt.hardware [None req-360a44c9-c7d6-45cf-8b44-119bac8f379e tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Image pref 0:0:0 {{(pid=118454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 18:31:41.542053 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.virt.hardware [None req-360a44c9-c7d6-45cf-8b44-119bac8f379e tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118454) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 18:31:41.551441 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-360a44c9-c7d6-45cf-8b44-119bac8f379e tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:31:41.551888 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-360a44c9-c7d6-45cf-8b44-119bac8f379e tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:31:41.552688 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-360a44c9-c7d6-45cf-8b44-119bac8f379e tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:31:41.553191 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-360a44c9-c7d6-45cf-8b44-119bac8f379e tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:31:41.570049 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.quota [None req-360a44c9-c7d6-45cf-8b44-119bac8f379e tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Getting quotas for project f1e8613cb3f4463a8450d22995801d40. Resources: {'cores', 'ram', 'instances'} {{(pid=118454) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 18:31:41.574026 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.quota [None req-360a44c9-c7d6-45cf-8b44-119bac8f379e tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Getting quotas for user 4649c6a25797428faacc2fd3857568df and project f1e8613cb3f4463a8450d22995801d40. Resources: {'cores', 'ram', 'instances'} {{(pid=118454) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 18:31:41.586322 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-360a44c9-c7d6-45cf-8b44-119bac8f379e tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Going to run 1 instances... {{(pid=118454) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 18:31:41.588603 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-360a44c9-c7d6-45cf-8b44-119bac8f379e tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] [instance: cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='61912422-61cd-4ced-a573-85ee305e010f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118454) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 18:31:41.706798 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: ERROR oslo.messaging._drivers.impl_rabbit [None req-360a44c9-c7d6-45cf-8b44-119bac8f379e tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] [962d8db1-22de-41dd-aa25-7a1947bea151] AMQP server on 10.222.0.86:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 28 18:31:42.715599 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO oslo.messaging._drivers.impl_rabbit [None req-360a44c9-c7d6-45cf-8b44-119bac8f379e tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] [962d8db1-22de-41dd-aa25-7a1947bea151] Reconnected to AMQP server on 10.222.0.86:5672 via [amqp] client with port 57018. Jul 28 18:31:42.720200 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-360a44c9-c7d6-45cf-8b44-119bac8f379e tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] 10.222.0.86 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.657856 Jul 28 18:31:42.720863 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 677/1349] 10.222.0.86 () {60 vars in 1147 bytes} [Thu Jul 28 18:31:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1660 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 18:31:42.731599 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-ce0336ed-049e-432d-abbb-bf6f8d243dfb tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:31:42.732329 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-ce0336ed-049e-432d-abbb-bf6f8d243dfb tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] [instance: cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:31:42.736296 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:31:42.737413 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:31:42.791958 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-ce0336ed-049e-432d-abbb-bf6f8d243dfb tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4649c6a25797428faacc2fd3857568df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e8613cb3f4463a8450d22995801d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:31:42.799912 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-ce0336ed-049e-432d-abbb-bf6f8d243dfb tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] 10.222.0.86 "GET /compute/v2.1/servers/cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8" status: 200 len: 1219 microversion: 2.1 time: 0.072172 Jul 28 18:31:42.802375 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 673/1350] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:31:42 2022] GET /compute/v2.1/servers/cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8 => generated 1219 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:31:43.820157 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-3e5948df-df4c-48e2-839e-54d2ac60df1d tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:31:43.820853 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-3e5948df-df4c-48e2-839e-54d2ac60df1d tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] [instance: cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:31:43.873148 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-3e5948df-df4c-48e2-839e-54d2ac60df1d tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4649c6a25797428faacc2fd3857568df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e8613cb3f4463a8450d22995801d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:31:43.880414 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-3e5948df-df4c-48e2-839e-54d2ac60df1d tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] 10.222.0.86 "GET /compute/v2.1/servers/cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8" status: 200 len: 1219 microversion: 2.1 time: 0.064645 Jul 28 18:31:43.880985 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 678/1351] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:31:43 2022] GET /compute/v2.1/servers/cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8 => generated 1219 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:31:44.901179 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-17e8460e-dffd-40fc-87b4-82a693609e2f tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:31:44.901834 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-17e8460e-dffd-40fc-87b4-82a693609e2f tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] [instance: cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:31:44.956287 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-17e8460e-dffd-40fc-87b4-82a693609e2f tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4649c6a25797428faacc2fd3857568df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e8613cb3f4463a8450d22995801d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:31:44.963160 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-17e8460e-dffd-40fc-87b4-82a693609e2f tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] 10.222.0.86 "GET /compute/v2.1/servers/cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8" status: 200 len: 1219 microversion: 2.1 time: 0.065773 Jul 28 18:31:44.963732 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 674/1352] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:31:44 2022] GET /compute/v2.1/servers/cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8 => generated 1219 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:31:45.983672 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-1fab5184-3d52-480e-af7a-7101fd9002d2 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:31:45.984287 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-1fab5184-3d52-480e-af7a-7101fd9002d2 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] [instance: cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:31:46.037772 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-1fab5184-3d52-480e-af7a-7101fd9002d2 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4649c6a25797428faacc2fd3857568df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e8613cb3f4463a8450d22995801d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:31:46.044373 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-1fab5184-3d52-480e-af7a-7101fd9002d2 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] 10.222.0.86 "GET /compute/v2.1/servers/cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8" status: 200 len: 1219 microversion: 2.1 time: 0.064630 Jul 28 18:31:46.044943 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 679/1353] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:31:45 2022] GET /compute/v2.1/servers/cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8 => generated 1219 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:31:47.064282 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-c36b3d87-0a16-474c-a04e-07e5b16c1409 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:31:47.064906 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-c36b3d87-0a16-474c-a04e-07e5b16c1409 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] [instance: cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:31:47.071612 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c36b3d87-0a16-474c-a04e-07e5b16c1409 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:31:47.072069 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c36b3d87-0a16-474c-a04e-07e5b16c1409 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:31:47.072839 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c36b3d87-0a16-474c-a04e-07e5b16c1409 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:31:47.073307 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-c36b3d87-0a16-474c-a04e-07e5b16c1409 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:31:47.133523 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-c36b3d87-0a16-474c-a04e-07e5b16c1409 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4649c6a25797428faacc2fd3857568df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e8613cb3f4463a8450d22995801d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:31:47.140922 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-c36b3d87-0a16-474c-a04e-07e5b16c1409 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] 10.222.0.86 "GET /compute/v2.1/servers/cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8" status: 200 len: 1223 microversion: 2.1 time: 0.081054 Jul 28 18:31:47.141517 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 675/1354] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:31:47 2022] GET /compute/v2.1/servers/cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8 => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:31:48.161117 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-57c3cc26-79c4-4210-bd63-1a3efbe145d0 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:31:48.161733 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-57c3cc26-79c4-4210-bd63-1a3efbe145d0 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] [instance: cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:31:48.168764 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-57c3cc26-79c4-4210-bd63-1a3efbe145d0 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:31:48.169246 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-57c3cc26-79c4-4210-bd63-1a3efbe145d0 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:31:48.170006 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-57c3cc26-79c4-4210-bd63-1a3efbe145d0 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:31:48.170991 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-57c3cc26-79c4-4210-bd63-1a3efbe145d0 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:31:48.230598 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-57c3cc26-79c4-4210-bd63-1a3efbe145d0 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4649c6a25797428faacc2fd3857568df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e8613cb3f4463a8450d22995801d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:31:48.238522 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-57c3cc26-79c4-4210-bd63-1a3efbe145d0 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] 10.222.0.86 "GET /compute/v2.1/servers/cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8" status: 200 len: 1271 microversion: 2.1 time: 0.081375 Jul 28 18:31:48.239081 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 680/1355] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:31:48 2022] GET /compute/v2.1/servers/cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8 => generated 1271 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:31:49.260527 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-8602eb84-303f-4f15-b928-04a0dff50291 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:31:49.261487 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-8602eb84-303f-4f15-b928-04a0dff50291 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] [instance: cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:31:49.268818 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8602eb84-303f-4f15-b928-04a0dff50291 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:31:49.269308 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8602eb84-303f-4f15-b928-04a0dff50291 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:31:49.270082 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8602eb84-303f-4f15-b928-04a0dff50291 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:31:49.270519 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8602eb84-303f-4f15-b928-04a0dff50291 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:31:49.402171 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8602eb84-303f-4f15-b928-04a0dff50291 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4649c6a25797428faacc2fd3857568df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e8613cb3f4463a8450d22995801d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:31:49.409726 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-8602eb84-303f-4f15-b928-04a0dff50291 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] 10.222.0.86 "GET /compute/v2.1/servers/cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8" status: 200 len: 1319 microversion: 2.1 time: 0.153970 Jul 28 18:31:49.410289 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 676/1356] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:31:49 2022] GET /compute/v2.1/servers/cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:31:50.116197 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [req-8ee11cb8-991c-4644-a656-8c8369ece985 req-6df8d251-0179-4fb0-a52d-7795de03c948 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8", "tag": "560ef11e-4852-4ee5-b1eb-429010962ff3"}]} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:31:50.127880 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-8ee11cb8-991c-4644-a656-8c8369ece985 req-6df8d251-0179-4fb0-a52d-7795de03c948 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:31:50.128324 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-8ee11cb8-991c-4644-a656-8c8369ece985 req-6df8d251-0179-4fb0-a52d-7795de03c948 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:31:50.139832 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.compute.server_external_events [req-8ee11cb8-991c-4644-a656-8c8369ece985 req-6df8d251-0179-4fb0-a52d-7795de03c948 service nova] Creating event network-changed:560ef11e-4852-4ee5-b1eb-429010962ff3 for instance cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8 on hv-cinder-84617 Jul 28 18:31:50.144609 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [req-8ee11cb8-991c-4644-a656-8c8369ece985 req-6df8d251-0179-4fb0-a52d-7795de03c948 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032283 Jul 28 18:31:50.145402 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 681/1357] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 18:31:50.430368 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-567768f0-a7fa-4dbc-98aa-f0dd3aba4a92 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:31:50.430998 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-567768f0-a7fa-4dbc-98aa-f0dd3aba4a92 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] [instance: cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:31:50.438120 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-567768f0-a7fa-4dbc-98aa-f0dd3aba4a92 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:31:50.439339 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-567768f0-a7fa-4dbc-98aa-f0dd3aba4a92 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:31:50.440213 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-567768f0-a7fa-4dbc-98aa-f0dd3aba4a92 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:31:50.440669 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-567768f0-a7fa-4dbc-98aa-f0dd3aba4a92 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:31:50.583271 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-567768f0-a7fa-4dbc-98aa-f0dd3aba4a92 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4649c6a25797428faacc2fd3857568df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e8613cb3f4463a8450d22995801d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:31:50.590866 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-567768f0-a7fa-4dbc-98aa-f0dd3aba4a92 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] 10.222.0.86 "GET /compute/v2.1/servers/cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8" status: 200 len: 1319 microversion: 2.1 time: 0.164453 Jul 28 18:31:50.591445 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 677/1358] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:31:50 2022] GET /compute/v2.1/servers/cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:31:51.609960 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell0:SELECT=2 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:31:51.614027 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-60c7e26d-7d1b-4896-bb09-6e15616dcfc7 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:31:51.614726 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-60c7e26d-7d1b-4896-bb09-6e15616dcfc7 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] [instance: cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:31:51.620792 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-60c7e26d-7d1b-4896-bb09-6e15616dcfc7 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:31:51.622544 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-60c7e26d-7d1b-4896-bb09-6e15616dcfc7 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:31:51.622544 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-60c7e26d-7d1b-4896-bb09-6e15616dcfc7 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:31:51.622544 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-60c7e26d-7d1b-4896-bb09-6e15616dcfc7 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:31:51.749404 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-60c7e26d-7d1b-4896-bb09-6e15616dcfc7 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4649c6a25797428faacc2fd3857568df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e8613cb3f4463a8450d22995801d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:31:51.756750 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-60c7e26d-7d1b-4896-bb09-6e15616dcfc7 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] 10.222.0.86 "GET /compute/v2.1/servers/cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8" status: 200 len: 1319 microversion: 2.1 time: 0.148861 Jul 28 18:31:51.757341 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 682/1359] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:31:51 2022] GET /compute/v2.1/servers/cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:31:52.778728 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-5bb4875b-0b00-4e0b-ba19-515c88dcd68b tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:31:52.779284 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-5bb4875b-0b00-4e0b-ba19-515c88dcd68b tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] [instance: cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:31:52.786457 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5bb4875b-0b00-4e0b-ba19-515c88dcd68b tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:31:52.786904 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5bb4875b-0b00-4e0b-ba19-515c88dcd68b tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:31:52.787666 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5bb4875b-0b00-4e0b-ba19-515c88dcd68b tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:31:52.788101 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-5bb4875b-0b00-4e0b-ba19-515c88dcd68b tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:31:52.920082 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-5bb4875b-0b00-4e0b-ba19-515c88dcd68b tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4649c6a25797428faacc2fd3857568df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e8613cb3f4463a8450d22995801d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:31:52.928378 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-5bb4875b-0b00-4e0b-ba19-515c88dcd68b tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] 10.222.0.86 "GET /compute/v2.1/servers/cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8" status: 200 len: 1319 microversion: 2.1 time: 0.153690 Jul 28 18:31:52.928942 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 678/1360] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:31:52 2022] GET /compute/v2.1/servers/cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:31:53.948290 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-bc39847c-567d-452e-8815-6822ffe4e0e5 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:31:53.948898 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-bc39847c-567d-452e-8815-6822ffe4e0e5 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] [instance: cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:31:53.955401 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-bc39847c-567d-452e-8815-6822ffe4e0e5 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:31:53.955840 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-bc39847c-567d-452e-8815-6822ffe4e0e5 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:31:53.956586 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-bc39847c-567d-452e-8815-6822ffe4e0e5 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:31:53.957073 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-bc39847c-567d-452e-8815-6822ffe4e0e5 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:31:54.085945 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-bc39847c-567d-452e-8815-6822ffe4e0e5 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4649c6a25797428faacc2fd3857568df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e8613cb3f4463a8450d22995801d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:31:54.093945 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-bc39847c-567d-452e-8815-6822ffe4e0e5 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] 10.222.0.86 "GET /compute/v2.1/servers/cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8" status: 200 len: 1319 microversion: 2.1 time: 0.149520 Jul 28 18:31:54.094506 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 683/1361] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:31:53 2022] GET /compute/v2.1/servers/cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:31:55.114384 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-3d5dfb04-fa42-4c1a-b62e-dd366dec69b8 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:31:55.114994 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-3d5dfb04-fa42-4c1a-b62e-dd366dec69b8 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] [instance: cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:31:55.117453 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell0:SELECT=4 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:31:55.122224 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3d5dfb04-fa42-4c1a-b62e-dd366dec69b8 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:31:55.122670 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3d5dfb04-fa42-4c1a-b62e-dd366dec69b8 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:31:55.123456 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3d5dfb04-fa42-4c1a-b62e-dd366dec69b8 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:31:55.123900 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-3d5dfb04-fa42-4c1a-b62e-dd366dec69b8 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:31:55.253398 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-3d5dfb04-fa42-4c1a-b62e-dd366dec69b8 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4649c6a25797428faacc2fd3857568df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e8613cb3f4463a8450d22995801d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:31:55.260681 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-3d5dfb04-fa42-4c1a-b62e-dd366dec69b8 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] 10.222.0.86 "GET /compute/v2.1/servers/cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8" status: 200 len: 1319 microversion: 2.1 time: 0.150148 Jul 28 18:31:55.261276 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 679/1362] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:31:55 2022] GET /compute/v2.1/servers/cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:31:56.280188 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-d49e4246-40d7-409f-9d1c-48125ff8022b tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:31:56.281525 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-d49e4246-40d7-409f-9d1c-48125ff8022b tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] [instance: cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:31:56.283700 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell0:SELECT=10 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:31:56.288446 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d49e4246-40d7-409f-9d1c-48125ff8022b tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:31:56.288892 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d49e4246-40d7-409f-9d1c-48125ff8022b tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:31:56.289685 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d49e4246-40d7-409f-9d1c-48125ff8022b tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:31:56.290125 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d49e4246-40d7-409f-9d1c-48125ff8022b tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:31:56.421367 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-d49e4246-40d7-409f-9d1c-48125ff8022b tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4649c6a25797428faacc2fd3857568df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e8613cb3f4463a8450d22995801d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:31:56.428806 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-d49e4246-40d7-409f-9d1c-48125ff8022b tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] 10.222.0.86 "GET /compute/v2.1/servers/cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8" status: 200 len: 1319 microversion: 2.1 time: 0.152481 Jul 28 18:31:56.429458 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 684/1363] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:31:56 2022] GET /compute/v2.1/servers/cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:31:57.449576 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-44ad246b-5adc-4e86-b6d0-f05e44703d35 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:31:57.450483 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-44ad246b-5adc-4e86-b6d0-f05e44703d35 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] [instance: cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:31:57.457677 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-44ad246b-5adc-4e86-b6d0-f05e44703d35 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:31:57.459606 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-44ad246b-5adc-4e86-b6d0-f05e44703d35 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:31:57.459606 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-44ad246b-5adc-4e86-b6d0-f05e44703d35 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:31:57.459606 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-44ad246b-5adc-4e86-b6d0-f05e44703d35 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:31:57.592334 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-44ad246b-5adc-4e86-b6d0-f05e44703d35 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4649c6a25797428faacc2fd3857568df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e8613cb3f4463a8450d22995801d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:31:57.600587 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-44ad246b-5adc-4e86-b6d0-f05e44703d35 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] 10.222.0.86 "GET /compute/v2.1/servers/cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8" status: 200 len: 1319 microversion: 2.1 time: 0.154935 Jul 28 18:31:57.601263 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 680/1364] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:31:57 2022] GET /compute/v2.1/servers/cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:31:57.622331 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [req-76972953-6a69-4511-a060-0924ddd3cc03 req-a5f4f66b-7089-46a1-9042-459b72057141 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8", "name": "network-vif-plugged", "status": "completed", "tag": "560ef11e-4852-4ee5-b1eb-429010962ff3"}]} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:31:57.632290 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-76972953-6a69-4511-a060-0924ddd3cc03 req-a5f4f66b-7089-46a1-9042-459b72057141 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:31:57.632730 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-76972953-6a69-4511-a060-0924ddd3cc03 req-a5f4f66b-7089-46a1-9042-459b72057141 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:31:57.644037 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.compute.server_external_events [req-76972953-6a69-4511-a060-0924ddd3cc03 req-a5f4f66b-7089-46a1-9042-459b72057141 service nova] Creating event network-vif-plugged:560ef11e-4852-4ee5-b1eb-429010962ff3 for instance cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8 on hv-cinder-84617 Jul 28 18:31:57.648953 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [req-76972953-6a69-4511-a060-0924ddd3cc03 req-a5f4f66b-7089-46a1-9042-459b72057141 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030331 Jul 28 18:31:57.649565 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 685/1365] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:31:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:31:58.620720 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-58cbfd5f-2e80-4d47-8e46-87419ffb6dda tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:31:58.621351 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-58cbfd5f-2e80-4d47-8e46-87419ffb6dda tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] [instance: cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:31:58.628008 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-58cbfd5f-2e80-4d47-8e46-87419ffb6dda tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:31:58.628449 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-58cbfd5f-2e80-4d47-8e46-87419ffb6dda tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:31:58.629232 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-58cbfd5f-2e80-4d47-8e46-87419ffb6dda tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:31:58.629666 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-58cbfd5f-2e80-4d47-8e46-87419ffb6dda tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:31:58.766857 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-58cbfd5f-2e80-4d47-8e46-87419ffb6dda tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4649c6a25797428faacc2fd3857568df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e8613cb3f4463a8450d22995801d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:31:58.774299 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-58cbfd5f-2e80-4d47-8e46-87419ffb6dda tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] 10.222.0.86 "GET /compute/v2.1/servers/cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8" status: 200 len: 1319 microversion: 2.1 time: 0.157426 Jul 28 18:31:58.774877 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 681/1366] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:31:58 2022] GET /compute/v2.1/servers/cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:31:59.800510 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-39cb2ed4-8acd-44e0-bab8-1e6343cf51d9 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:31:59.800510 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-39cb2ed4-8acd-44e0-bab8-1e6343cf51d9 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] [instance: cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:31:59.804201 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-39cb2ed4-8acd-44e0-bab8-1e6343cf51d9 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:31:59.804645 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-39cb2ed4-8acd-44e0-bab8-1e6343cf51d9 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:31:59.805434 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-39cb2ed4-8acd-44e0-bab8-1e6343cf51d9 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:31:59.805874 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-39cb2ed4-8acd-44e0-bab8-1e6343cf51d9 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:31:59.939628 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-39cb2ed4-8acd-44e0-bab8-1e6343cf51d9 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4649c6a25797428faacc2fd3857568df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e8613cb3f4463a8450d22995801d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:31:59.947054 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-39cb2ed4-8acd-44e0-bab8-1e6343cf51d9 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] 10.222.0.86 "GET /compute/v2.1/servers/cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8" status: 200 len: 1319 microversion: 2.1 time: 0.155182 Jul 28 18:31:59.947615 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 686/1367] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:31:59 2022] GET /compute/v2.1/servers/cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:32:00.967636 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-8170e502-f2ae-4621-8dfe-8c13cdb82764 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:32:00.968281 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-8170e502-f2ae-4621-8dfe-8c13cdb82764 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] [instance: cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:32:00.974772 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8170e502-f2ae-4621-8dfe-8c13cdb82764 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:32:00.975224 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8170e502-f2ae-4621-8dfe-8c13cdb82764 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:32:00.975983 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8170e502-f2ae-4621-8dfe-8c13cdb82764 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:32:00.976418 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-8170e502-f2ae-4621-8dfe-8c13cdb82764 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:32:01.106306 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-8170e502-f2ae-4621-8dfe-8c13cdb82764 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4649c6a25797428faacc2fd3857568df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e8613cb3f4463a8450d22995801d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:32:01.113801 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-8170e502-f2ae-4621-8dfe-8c13cdb82764 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] 10.222.0.86 "GET /compute/v2.1/servers/cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8" status: 200 len: 1507 microversion: 2.1 time: 0.150060 Jul 28 18:32:01.114359 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 682/1368] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:32:00 2022] GET /compute/v2.1/servers/cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8 => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:32:01.134295 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-ea705ac9-3932-4fa8-83d6-ace85d6af3b5 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "203fb018-40c1-4869-b3e8-32d270f51a90", "device": "/dev/sdb"}} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:32:01.137233 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-ea705ac9-3932-4fa8-83d6-ace85d6af3b5 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] [instance: cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:32:01.144289 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ea705ac9-3932-4fa8-83d6-ace85d6af3b5 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:32:01.144740 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ea705ac9-3932-4fa8-83d6-ace85d6af3b5 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:32:01.145533 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ea705ac9-3932-4fa8-83d6-ace85d6af3b5 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:32:01.145967 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-ea705ac9-3932-4fa8-83d6-ace85d6af3b5 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:32:01.802347 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-ea705ac9-3932-4fa8-83d6-ace85d6af3b5 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] 10.222.0.86 "POST /compute/v2.1/servers/cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.671850 Jul 28 18:32:01.802951 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 687/1369] 10.222.0.86 () {60 vars in 1323 bytes} [Thu Jul 28 18:32:01 2022] POST /compute/v2.1/servers/cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8/os-volume_attachments => generated 194 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:32:23.818633 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-d1281d02-b817-4d9e-ab66-56767215bb28 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:32:23.819208 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-d1281d02-b817-4d9e-ab66-56767215bb28 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] [instance: cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:32:23.821229 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_api:SELECT=24 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:32:23.821969 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG dbcounter [-] [118453] Writing DB stats nova_cell1:SELECT=48 {{(pid=118453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:32:23.826899 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d1281d02-b817-4d9e-ab66-56767215bb28 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:32:23.827766 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d1281d02-b817-4d9e-ab66-56767215bb28 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:32:23.828241 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d1281d02-b817-4d9e-ab66-56767215bb28 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:32:23.828683 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-d1281d02-b817-4d9e-ab66-56767215bb28 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:32:23.907542 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.objects.instance [None req-d1281d02-b817-4d9e-ab66-56767215bb28 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lazy-loading 'services' on Instance uuid cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8 {{(pid=118453) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:32:24.099807 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-d1281d02-b817-4d9e-ab66-56767215bb28 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] 10.222.0.86 "DELETE /compute/v2.1/servers/cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8/os-volume_attachments/203fb018-40c1-4869-b3e8-32d270f51a90" status: 202 len: 0 microversion: 2.1 time: 0.285104 Jul 28 18:32:24.100455 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 683/1370] 10.222.0.86 () {58 vars in 1416 bytes} [Thu Jul 28 18:32:23 2022] DELETE /compute/v2.1/servers/cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8/os-volume_attachments/203fb018-40c1-4869-b3e8-32d270f51a90 => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 18:32:26.273665 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:32:26.274482 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG dbcounter [-] [118454] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:32:26.278467 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-d03e2070-99d4-440c-92b7-472cd299ce72 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:32:26.279056 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-d03e2070-99d4-440c-92b7-472cd299ce72 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] [instance: cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:32:26.285768 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d03e2070-99d4-440c-92b7-472cd299ce72 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:32:26.286218 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d03e2070-99d4-440c-92b7-472cd299ce72 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:32:26.286982 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d03e2070-99d4-440c-92b7-472cd299ce72 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:32:26.287427 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-d03e2070-99d4-440c-92b7-472cd299ce72 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:32:26.312984 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-d03e2070-99d4-440c-92b7-472cd299ce72 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] [instance: cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8] Going to try to terminate instance {{(pid=118454) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 18:32:26.517469 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-d03e2070-99d4-440c-92b7-472cd299ce72 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] 10.222.0.86 "DELETE /compute/v2.1/servers/cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8" status: 204 len: 0 microversion: 2.1 time: 0.244906 Jul 28 18:32:26.517985 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 688/1371] 10.222.0.86 () {58 vars in 1239 bytes} [Thu Jul 28 18:32:26 2022] DELETE /compute/v2.1/servers/cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 18:32:26.527172 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-13e2dc3b-1160-4457-bc3d-4504c8f5763c tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:32:26.527869 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-13e2dc3b-1160-4457-bc3d-4504c8f5763c tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] [instance: cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:32:26.534670 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-13e2dc3b-1160-4457-bc3d-4504c8f5763c tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:32:26.535122 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-13e2dc3b-1160-4457-bc3d-4504c8f5763c tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:32:26.535883 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-13e2dc3b-1160-4457-bc3d-4504c8f5763c tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:32:26.536391 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-13e2dc3b-1160-4457-bc3d-4504c8f5763c tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:32:26.665871 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-13e2dc3b-1160-4457-bc3d-4504c8f5763c tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4649c6a25797428faacc2fd3857568df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e8613cb3f4463a8450d22995801d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:32:26.673374 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-13e2dc3b-1160-4457-bc3d-4504c8f5763c tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] 10.222.0.86 "GET /compute/v2.1/servers/cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8" status: 200 len: 1513 microversion: 2.1 time: 0.150955 Jul 28 18:32:26.673942 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 684/1372] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:32:26 2022] GET /compute/v2.1/servers/cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8 => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:32:27.695276 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [None req-b477bcae-f003-4a4b-b7fb-f4953b1af7ed tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Calling method '>' {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:32:27.695986 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.compute.api [None req-b477bcae-f003-4a4b-b7fb-f4953b1af7ed tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] [instance: cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8] Fetching instance by UUID {{(pid=118454) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:32:27.702773 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b477bcae-f003-4a4b-b7fb-f4953b1af7ed tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:32:27.703225 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b477bcae-f003-4a4b-b7fb-f4953b1af7ed tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:32:27.703993 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b477bcae-f003-4a4b-b7fb-f4953b1af7ed tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:32:27.704437 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [None req-b477bcae-f003-4a4b-b7fb-f4953b1af7ed tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:32:27.831792 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.policy [None req-b477bcae-f003-4a4b-b7fb-f4953b1af7ed tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4649c6a25797428faacc2fd3857568df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e8613cb3f4463a8450d22995801d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118454) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:32:27.839273 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [None req-b477bcae-f003-4a4b-b7fb-f4953b1af7ed tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] 10.222.0.86 "GET /compute/v2.1/servers/cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8" status: 200 len: 1513 microversion: 2.1 time: 0.148910 Jul 28 18:32:27.839845 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 689/1373] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:32:27 2022] GET /compute/v2.1/servers/cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8 => generated 1513 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:32:28.859805 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-1e2a6d42-6749-40ba-8ff0-2efef5f419bf tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:32:28.860452 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-1e2a6d42-6749-40ba-8ff0-2efef5f419bf tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] [instance: cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:32:28.867417 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1e2a6d42-6749-40ba-8ff0-2efef5f419bf tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:32:28.872525 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1e2a6d42-6749-40ba-8ff0-2efef5f419bf tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:32:28.872525 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1e2a6d42-6749-40ba-8ff0-2efef5f419bf tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:32:28.872525 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-1e2a6d42-6749-40ba-8ff0-2efef5f419bf tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:32:29.000484 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.policy [None req-1e2a6d42-6749-40ba-8ff0-2efef5f419bf tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4649c6a25797428faacc2fd3857568df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e8613cb3f4463a8450d22995801d40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118453) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:32:29.010395 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-1e2a6d42-6749-40ba-8ff0-2efef5f419bf tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] 10.222.0.86 "GET /compute/v2.1/servers/cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8" status: 200 len: 1513 microversion: 2.1 time: 0.152972 Jul 28 18:32:29.010395 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 685/1374] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:32:28 2022] GET /compute/v2.1/servers/cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:32:29.086178 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG nova.api.openstack.wsgi [req-488b1988-5295-4798-89a6-b8f3ff636f19 req-d3ad2e4e-637c-4f95-ad1f-7bfbf73ac5b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8", "name": "network-vif-deleted", "tag": "560ef11e-4852-4ee5-b1eb-429010962ff3"}]} {{(pid=118454) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:32:29.095904 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-488b1988-5295-4798-89a6-b8f3ff636f19 req-d3ad2e4e-637c-4f95-ad1f-7bfbf73ac5b4 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:32:29.098788 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: DEBUG oslo_concurrency.lockutils [req-488b1988-5295-4798-89a6-b8f3ff636f19 req-d3ad2e4e-637c-4f95-ad1f-7bfbf73ac5b4 service nova] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118454) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:32:29.107583 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.compute.server_external_events [req-488b1988-5295-4798-89a6-b8f3ff636f19 req-d3ad2e4e-637c-4f95-ad1f-7bfbf73ac5b4 service nova] Creating event network-vif-deleted:560ef11e-4852-4ee5-b1eb-429010962ff3 for instance cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8 on hv-cinder-84617 Jul 28 18:32:29.112979 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO nova.api.openstack.requestlog [req-488b1988-5295-4798-89a6-b8f3ff636f19 req-d3ad2e4e-637c-4f95-ad1f-7bfbf73ac5b4 service nova] 10.222.0.86 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030427 Jul 28 18:32:29.117854 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: [pid: 118454|app: 0|req: 690/1375] 10.222.0.86 () {64 vars in 1317 bytes} [Thu Jul 28 18:32:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:32:30.032859 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f6cd4a2f-ab3e-4bb4-beb3-76f46bbcd029 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Calling method '>' {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:32:30.033465 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.compute.api [None req-f6cd4a2f-ab3e-4bb4-beb3-76f46bbcd029 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] [instance: cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8] Fetching instance by UUID {{(pid=118453) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:32:30.044505 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f6cd4a2f-ab3e-4bb4-beb3-76f46bbcd029 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:32:30.044957 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f6cd4a2f-ab3e-4bb4-beb3-76f46bbcd029 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:32:30.045766 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f6cd4a2f-ab3e-4bb4-beb3-76f46bbcd029 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:32:30.046252 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG oslo_concurrency.lockutils [None req-f6cd4a2f-ab3e-4bb4-beb3-76f46bbcd029 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Lock "e78b579e-79d5-47c3-990c-b247b1ada0c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118453) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:32:30.060053 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.wsgi [None req-f6cd4a2f-ab3e-4bb4-beb3-76f46bbcd029 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] HTTP exception thrown: Instance cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8 could not be found. Jul 28 18:32:30.061731 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f6cd4a2f-ab3e-4bb4-beb3-76f46bbcd029 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Request method failure captured: Jul 28 18:32:30.061731 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: request: GET /compute/v2.1/servers/cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8 HTTP/1.1 Jul 28 18:32:30.061731 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Accept: application/json Jul 28 18:32:30.061731 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Accept-Encoding: identity Jul 28 18:32:30.061731 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Connection: close Jul 28 18:32:30.061731 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Content-Length: 0 Jul 28 18:32:30.061731 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Content-Type: application/json Jul 28 18:32:30.061731 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Host: 10.222.0.86 Jul 28 18:32:30.061731 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Openstack-System-Scope: None Jul 28 18:32:30.061731 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: User-Agent: python-urllib3/1.26.10 Jul 28 18:32:30.061731 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Auth-Token: gAAAAABi4tW1twlqeNpGqjK-I4JG7wPLi59d96gjTF5Gej8rY9nJh2C8h43uZBcw9chVgUJS2yq0EwRSQQWfMC8Tuv02DWaWXsa1BCyj6z8vodLIbElo2FfDZhsmnGAIupYHQL26w7iHDu9RDu8sU_-Z5COH9ldg3FRx8TT9aC8FXGTaN0hNjAA Jul 28 18:32:30.061731 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Domain-Id: None Jul 28 18:32:30.061731 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Domain-Name: None Jul 28 18:32:30.061731 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Identity-Status: Confirmed Jul 28 18:32:30.061731 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Is-Admin-Project: True Jul 28 18:32:30.061731 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Id: default Jul 28 18:32:30.061731 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Domain-Name: Default Jul 28 18:32:30.061731 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Id: f1e8613cb3f4463a8450d22995801d40 Jul 28 18:32:30.061731 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1682304737 Jul 28 18:32:30.061731 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Role: member,reader Jul 28 18:32:30.061731 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Roles: member,reader Jul 28 18:32:30.063809 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.86:8080", "publicURL": "http://10.222.0.86:8080/v1/AUTH_f1e8613cb3f4463a8450d22995801d40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/f1e8613cb3f4463a8450d22995801d40"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2/f1e8613cb3f4463a8450d22995801d40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/volume/v3/f1e8613cb3f4463a8450d22995801d40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.86/image"}]}] Jul 28 18:32:30.063809 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant: tempest-VolumesSnapshotTestJSON-1682304737 Jul 28 18:32:30.063809 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant-Id: f1e8613cb3f4463a8450d22995801d40 Jul 28 18:32:30.063809 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1682304737 Jul 28 18:32:30.063809 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User: tempest-VolumesSnapshotTestJSON-1682304737-project Jul 28 18:32:30.063809 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Id: default Jul 28 18:32:30.063809 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Domain-Name: Default Jul 28 18:32:30.063809 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Id: 4649c6a25797428faacc2fd3857568df Jul 28 18:32:30.063809 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: X-User-Name: tempest-VolumesSnapshotTestJSON-1682304737-project Jul 28 18:32:30.063809 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: method: > Jul 28 18:32:30.063809 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: exception: Instance cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8 could not be found. Jul 28 18:32:30.063809 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: action_args: {'id': 'cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8'} Jul 28 18:32:30.064885 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: {{(pid=118453) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:32:30.064885 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:32:30.064885 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:32:30.064885 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:32:30.064885 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:32:30.064885 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:32:30.064885 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:32:30.064885 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:32:30.064885 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:32:30.064885 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:32:30.064885 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8 could not be found. Jul 28 18:32:30.064885 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:32:30.064885 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:32:30.064885 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:32:30.064885 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:32:30.064885 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:32:30.064885 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:32:30.064885 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:32:30.064885 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:32:30.064885 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:32:30.066840 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:32:30.066840 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 18:32:30.066840 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 18:32:30.066840 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:32:30.066840 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:32:30.066840 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:32:30.066840 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:32:30.066840 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8 could not be found. Jul 28 18:32:30.066840 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:32:30.066840 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:32:30.066840 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:32:30.066840 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:32:30.066840 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:32:30.066840 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:32:30.066840 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:32:30.066840 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:32:30.066840 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8 could not be found. Jul 28 18:32:30.066840 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: ERROR nova.api.openstack.wsgi Jul 28 18:32:30.068506 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: DEBUG nova.api.openstack.wsgi [None req-f6cd4a2f-ab3e-4bb4-beb3-76f46bbcd029 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] Returning 404 to user: Instance cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8 could not be found. {{(pid=118453) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:32:30.068506 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO nova.api.openstack.requestlog [None req-f6cd4a2f-ab3e-4bb4-beb3-76f46bbcd029 tempest-VolumesSnapshotTestJSON-1682304737 tempest-VolumesSnapshotTestJSON-1682304737-project] 10.222.0.86 "GET /compute/v2.1/servers/cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8" status: 404 len: 111 microversion: 2.1 time: 0.036498 Jul 28 18:32:30.068506 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: [pid: 118453|app: 0|req: 686/1376] 10.222.0.86 () {58 vars in 1236 bytes} [Thu Jul 28 18:32:30 2022] GET /compute/v2.1/servers/cbd92ee9-ebd1-41b4-9694-3bb4fb4344e8 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:32:41.825118 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 18:32:41.825719 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Thu Jul 28 18:32:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 18:32:41.852535 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 18:32:41.853058 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Thu Jul 28 18:32:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 18:35:04.688745 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 18:35:04.689587 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Thu Jul 28 18:35:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 18:35:18.766691 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 18:35:18.767293 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Thu Jul 28 18:35:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 18:35:21.262369 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 18:35:21.263038 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Thu Jul 28 18:35:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 18:35:35.304400 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 18:35:35.305008 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Thu Jul 28 18:35:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 18:37:41.833481 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 18:37:41.834225 dv-cinder-846173-4-iscsi devstack@n-api.service[118454]: Thu Jul 28 18:37:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 18:37:41.860174 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 18:37:41.860602 dv-cinder-846173-4-iscsi devstack@n-api.service[118453]: Thu Jul 28 18:37:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!